Jul 17 19:31:05 devstack cinder-volume[76547]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 17 19:31:05 devstack cinder-volume[76547]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 17 19:31:05 devstack cinder-volume[76547]: we strongly recommend against using it for new projects. Jul 17 19:31:05 devstack cinder-volume[76547]: If you are already using Eventlet, we recommend migrating to a different Jul 17 19:31:05 devstack cinder-volume[76547]: framework. For more detail see Jul 17 19:31:05 devstack cinder-volume[76547]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 17 19:31:05 devstack cinder-volume[76547]: import eventlet # noqa Jul 17 19:31:08 devstack cinder-volume[76547]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76547) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 19:31:08 devstack cinder-volume[76547]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76547) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 19:31:08 devstack cinder-volume[76547]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76547) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 19:31:09 devstack cinder-volume[76547]: INFO dbcounter [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Registered counter for database cinder Jul 17 19:31:09 devstack cinder-volume[76547]: DEBUG oslo_db.sqlalchemy.engines [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76547) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 19:31:09 devstack cinder-volume[76547]: DEBUG dbcounter [-] [76547] Writer thread running {{(pid=76547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 17 19:31:09 devstack cinder-volume[76547]: INFO cinder.rpc [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 17 19:31:09 devstack cinder-volume[76547]: INFO cinder.rpc [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_db.sqlalchemy.engines [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76547) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 19:31:10 devstack cinder-volume[76547]: INFO cinder.volume.manager [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Determined volume DB was empty at startup. Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG cinder.volume.manager [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76547) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 17 19:31:10 devstack cinder-volume[76547]: INFO cinder.volume.manager [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 17 19:31:10 devstack cinder-volume[76547]: WARNING stevedore.named [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 17 19:31:10 devstack cinder-volume[76547]: WARNING castellan.key_manager [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 19:31:10 devstack cinder-volume[76547]: WARNING cinder.keymgr.conf_key_mgr [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG cinder.volume.drivers.lvm [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76547) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_concurrency.processutils [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_concurrency.processutils [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] CMD "cinder-rtstool verify" returned: 0 in 0.428s {{(pid=76547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_db.sqlalchemy.engines [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76547) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 19:31:10 devstack cinder-volume[76547]: INFO cinder.rpc [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 17 19:31:10 devstack cinder-volume[76547]: INFO cinder.rpc [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 17 19:31:10 devstack cinder-volume[76547]: WARNING stevedore.named [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 17 19:31:10 devstack cinder-volume[76547]: WARNING castellan.key_manager [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 19:31:10 devstack cinder-volume[76547]: INFO cinder.volume.manager [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_db.sqlalchemy.engines [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76547) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 19:31:10 devstack cinder-volume[76547]: INFO oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Starting 1 workers Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Started child 76699 {{(pid=76547) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Full set of CONF: {{(pid=76547) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] ******************************************************************************** {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Configuration options gathered from: {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 17 19:31:10 devstack cinder-volume[76699]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] ================================================================================ {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] allow_availability_zone_fallback = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] allow_compression_on_image_upload = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] allowed_direct_url_schemes = [] {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] api_rate_limit = True {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] auth_strategy = keystone {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] az_cache_duration = 3600 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_availability_zone = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_host = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_name = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_stats_polling_interval = 60 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backup_api_class = cinder.backup.api.API {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backup_name_template = backup-%s {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backup_use_same_host = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backup_use_temp_snapshot = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] chap_password = **** {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] chap_username = {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cinder_internal_tenant_project_id = 2af132a92b524df98f4c58e35cbe68bd {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cinder_internal_tenant_user_id = a4b660f49bc14e15bbe22a25a5642f4c {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cloned_volume_same_az = True {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cluster = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] compression_format = gzip {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] compute_api_class = cinder.compute.nova.API {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] config_dir = [] {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] config_source = [] {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] control_exchange = openstack {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] debug = True {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] default_availability_zone = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] default_group_type = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] default_volume_type = lvmdriver-1 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] disk_geometry = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] driver_client_cert = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] driver_client_cert_key = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] driver_data_namespace = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] driver_ssl_cert_path = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] driver_ssl_cert_verify = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] driver_use_ssl = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] enable_force_upload = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] enable_new_services = True {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] enable_unsupported_driver = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] enforce_multipath_for_image_xfer = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] filter_function = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] glance_api_insecure = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] glance_api_servers = ['http://192.168.122.254/image'] {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] glance_api_ssl_compression = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] glance_ca_certificates_file = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] glance_catalog_info = image:glance:publicURL {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] glance_certfile = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] glance_keyfile = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] glance_num_retries = 3 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] glance_request_timeout = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] goodness_function = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] graceful_shutdown_timeout = 5 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] group_api_class = cinder.group.api.API {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] host = devstack {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] image_compress_on_upload = True {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] image_conversion_address_space_limit = 1 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] image_conversion_cpu_limit = 60 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] image_conversion_disable = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] image_upload_use_cinder_backend = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] image_upload_use_internal_tenant = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] image_volume_cache_enabled = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] image_volume_cache_max_count = 0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] image_volume_cache_max_size_gb = 0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] init_host_max_objects_retrieval = 0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] instance_format = [instance: %(uuid)s] {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] iscsi_target_flags = {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] iscsi_write_cache = on {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] iser_helper = tgtadm {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] iser_ip_address = 192.168.122.254 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] iser_port = 3260 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] log_color = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] log_config_append = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] log_dir = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] log_file = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] log_options = True {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] log_rotate_interval = 1 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] log_rotate_interval_type = days {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] log_rotation_type = none {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] max_age = 0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] max_logfile_count = 30 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] max_logfile_size_mb = 200 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] max_over_subscription_ratio = 20.0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] message_reap_interval = 86400 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] message_ttl = 2592000 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] migration_create_volume_timeout_secs = 300 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] monkey_patch = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] monkey_patch_modules = [] {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] my_ip = 192.168.122.254 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] no_snapshot_gb_quota = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] num_iser_scan_tries = 3 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] num_shell_tries = 3 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] num_volume_device_scan_tries = 3 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] nvmeof_conn_info_version = 1 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] nvmet_ns_id = 10 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] nvmet_port_id = 1 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] osapi_max_limit = 1000 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] osapi_volume_ext_list = [] {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] osapi_volume_listen_port = 8776 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] osapi_volume_use_ssl = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] osapi_volume_workers = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] per_volume_size_limit = -1 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] periodic_fuzzy_delay = 60 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] periodic_interval = 60 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] public_endpoint = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] publish_errors = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] quota_backup_gigabytes = 1000 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] quota_backups = 10 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] quota_gigabytes = 1000 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] quota_groups = 10 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] quota_snapshots = 10 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] quota_volumes = 10 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] rate_limit_burst = 0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] rate_limit_except_level = CRITICAL {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] rate_limit_interval = 0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] reinit_driver_count = 3 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] replication_device = **** {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] report_discard_supported = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76699]: INFO cinder.volume.manager [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] report_interval = 120 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] reservation_clean_interval = 86400 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] reservation_expire = 86400 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] reserved_image_namespaces = [] {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] reserved_percentage = 0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] rpc_response_timeout = 120 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] run_external_periodic_tasks = True {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] scst_target_driver = iscsi {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] scst_target_iqn_name = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] service_down_time = 720 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] shell_completion = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] snapshot_name_template = snapshot-%s {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] snapshot_same_host = True {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] split_loggers = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] state_path = /opt/stack/data/cinder {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] storage_availability_zone = nova {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] storage_protocol = iSCSI {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] syslog_log_facility = LOG_USER {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] target_helper = lioadm {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] target_ip_address = 192.168.122.254 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] target_port = 3260 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] target_protocol = iscsi {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] target_secondary_ip_addresses = [] {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] trace_flags = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] transport_url = **** {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] until_refresh = 0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] use_chap_auth = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] use_default_quota_class = True {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] use_journal = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] use_json = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] use_multipath_for_image_xfer = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] use_stderr = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] use_syslog = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] verify_glance_signatures = enabled {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] volume_api_class = cinder.volume.api.API {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] volume_backend_name = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] volume_clear = zero {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] volume_clear_ionice = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] volume_clear_size = 0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] volume_copy_bps_limit = 0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] volume_dd_blocksize = 1M {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] volume_name_template = volume-%s {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] volume_service_inithost_offload = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] volume_usage_audit_period = month {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] zoning_mode = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_concurrency.disable_process_locking = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.auth_section = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.auth_type = password {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.auth_version = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.cache = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.certfile = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.include_service_catalog = True {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.insecure = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.interface = public {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.keyfile = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.memcache_password = {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.memcache_username = {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.region_name = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.service_type = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.254/identity {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.backend = dogpile.cache.null {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.backend_argument = **** {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.backend_expiration_time = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.config_prefix = cache.oslo {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.debug_cache_backend = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.enable_retry_client = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.enable_socket_keepalive = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.enabled = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.expiration_time = 600 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.hashclient_retry_attempts = 2 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.memcache_dead_retry = 300 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.memcache_pool_maxsize = 10 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.memcache_sasl_enabled = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.password = **** {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.proxies = [] {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.redis_db = 0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.redis_server = localhost:6379 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.retry_attempts = 2 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.retry_delay = 0.0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.socket_keepalive_count = 1 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.socket_keepalive_idle = 1 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.socket_keepalive_interval = 1 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.socket_timeout = 1.0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.tls_allowed_ciphers = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.tls_cafile = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.tls_certfile = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.tls_enabled = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.tls_keyfile = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cache.username = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] coordination.backend_url = **** {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] database.asyncio_connection = **** {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] database.asyncio_slave_connection = **** {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] database.backend = sqlalchemy {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] database.connection = **** {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] database.connection_debug = 0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] database.connection_parameters = {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] database.connection_recycle_time = 3600 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] database.connection_trace = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] database.db_inc_retry_interval = True {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] database.db_max_retries = 20 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.059s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:10 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] database.db_max_retry_interval = 10 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] database.db_retry_interval = 1 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] database.max_overflow = 50 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] database.max_pool_size = 5 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] database.max_retries = 10 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] database.mysql_wsrep_sync_wait = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] database.pool_timeout = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] database.retry_interval = 10 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] database.slave_connection = **** {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] database.sqlite_synchronous = True {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] database.synchronous_reader = True {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] database.use_db_reconnect = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:10 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] profiler.connection_string = messaging:// {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] profiler.enabled = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] profiler.es_doc_type = notification {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] profiler.es_scroll_size = 10000 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] profiler.es_scroll_time = 2m {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] profiler.filter_error_trace = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] profiler.hmac_keys = **** {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] profiler.sentinel_service_name = mymaster {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] profiler.socket_timeout = 0.1 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] profiler.trace_requests = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] profiler.trace_sqlalchemy = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] profiler_jaeger.process_tags = {} {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] profiler_jaeger.service_name_prefix = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] profiler_otlp.service_name_prefix = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_policy.enforce_new_defaults = True {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_policy.policy_default_rule = default {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_policy.policy_file = policy.yaml {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] privsep_osbrick.group = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] privsep_osbrick.helper_command = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] privsep_osbrick.user = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cinder_sys_admin.group = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cinder_sys_admin.helper_command = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] cinder_sys_admin.user = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] service_user.auth_section = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] service_user.auth_type = password {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] service_user.cafile = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] service_user.certfile = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] service_user.collect_timing = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] service_user.insecure = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] service_user.keyfile = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] service_user.send_service_user_token = True {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] service_user.split_loggers = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] service_user.timeout = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] glance.auth_section = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] glance.auth_type = password {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] glance.certfile = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] glance.collect_timing = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] glance.insecure = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] glance.keyfile = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] glance.region_name = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] glance.split_loggers = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] glance.timeout = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.backend_availability_zone = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.chap_password = **** {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.chap_username = {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.disk_geometry = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.driver_client_cert = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.driver_client_cert_key = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.driver_data_namespace = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.driver_use_ssl = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.extra_capabilities = {} {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.filter_function = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.goodness_function = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.iscsi_target_flags = {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.iscsi_write_cache = on {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.iser_helper = tgtadm {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.iser_ip_address = 192.168.122.254 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.iser_port = 3260 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.lvm_share_target = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.lvm_type = auto {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.num_shell_tries = 3 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.replication_device = **** {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.report_discard_supported = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.reserved_percentage = 0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.target_helper = tgtadm {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.target_ip_address = 192.168.122.254 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.target_port = 3260 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.target_protocol = iscsi {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.trace_flags = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.unique_fqdn_network = True {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.use_chap_auth = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.volume_backend_name = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.volume_clear = zero {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.volume_clear_ionice = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.volume_clear_size = 0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_reports.file_event_handler = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_reports.log_dir = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.backend_host = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.chap_password = **** {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.chap_username = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.disk_geometry = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.driver_client_cert = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.extra_capabilities = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.filter_function = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.goodness_function = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.iser_helper = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.iser_ip_address = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.iser_port = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.lvm_share_target = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.lvm_type = auto {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.num_shell_tries = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.replication_device = **** {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.report_discard_supported = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.reserved_percentage = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.scst_target_driver = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.storage_protocol = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.target_helper = lioadm {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.target_ip_address = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.target_port = 3260 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.trace_flags = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.use_chap_auth = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.volume_clear = zero {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.volume_clear_size = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] lvmdriver-1.volumes_dir = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack sudo[76704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack sudo[76704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.ssl = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_notifications.driver = [] {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_notifications.retry = -1 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] key_manager.fixed_key = **** {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] barbican.barbican_api_version = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] barbican.barbican_endpoint = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] barbican.barbican_endpoint_type = public {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] barbican.barbican_region_name = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] barbican.cafile = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] barbican.certfile = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] barbican.collect_timing = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] barbican.insecure = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] barbican.keyfile = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] barbican.number_of_retries = 60 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] barbican.retry_delay = 1 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] barbican.send_service_user_token = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] barbican.split_loggers = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] barbican.timeout = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] barbican.verify_ssl = True {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] barbican.verify_ssl_path = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] barbican_service_user.auth_section = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] barbican_service_user.auth_type = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] barbican_service_user.cafile = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] barbican_service_user.certfile = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] barbican_service_user.collect_timing = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] barbican_service_user.insecure = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] barbican_service_user.keyfile = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] barbican_service_user.split_loggers = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] barbican_service_user.timeout = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] vault.approle_role_id = **** {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] vault.approle_secret_id = **** {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] vault.auth_method = approle {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] vault.auth_path = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] vault.kv_mountpoint = secret {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] vault.kv_path = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] vault.kv_version = 2 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] vault.namespace = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] vault.root_token_id = **** {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] vault.ssl_ca_crt_file = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] vault.timeout = 60.0 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] vault.token_file = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] vault.token_role = None {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] vault.use_ssl = False {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:31:11 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] ******************************************************************************** {{(pid=76547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 17 19:31:11 devstack sudo[76704]: pam_unix(sudo:session): session closed for user root Jul 17 19:31:11 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.353s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:11 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:11 devstack sudo[76711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 19:31:11 devstack sudo[76711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:31:11 devstack sudo[76711]: pam_unix(sudo:session): session closed for user root Jul 17 19:31:11 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.344s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:11 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 19:31:11 devstack cinder-volume[76699]: INFO cinder.brick.local_dev.lvm [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 17 19:31:11 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:11 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:11 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:11 devstack sudo[76852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 19:31:11 devstack sudo[76852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:31:12 devstack sudo[76852]: pam_unix(sudo:session): session closed for user root Jul 17 19:31:12 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:12 devstack cinder-volume[76699]: DEBUG cinder.brick.local_dev.lvm [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76699) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 17 19:31:12 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:12 devstack sudo[76934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 19:31:12 devstack sudo[76934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:31:12 devstack sudo[76934]: pam_unix(sudo:session): session closed for user root Jul 17 19:31:12 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.497s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:12 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:12 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:12 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:12 devstack sudo[77115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 19:31:12 devstack sudo[77115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:31:12 devstack sudo[77115]: pam_unix(sudo:session): session closed for user root Jul 17 19:31:12 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:12 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:12 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:12 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:12 devstack sudo[77204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 17 19:31:12 devstack sudo[77204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:31:13 devstack sudo[77204]: pam_unix(sudo:session): session closed for user root Jul 17 19:31:13 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.309s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:13 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:13 devstack sudo[77318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 19:31:13 devstack sudo[77318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:31:13 devstack sudo[77318]: pam_unix(sudo:session): session closed for user root Jul 17 19:31:13 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:13 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:13 devstack sudo[77321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 19:31:13 devstack sudo[77321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:31:13 devstack sudo[77321]: pam_unix(sudo:session): session closed for user root Jul 17 19:31:13 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.342s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:13 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:13 devstack sudo[77404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 19:31:13 devstack sudo[77404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:31:14 devstack sudo[77404]: pam_unix(sudo:session): session closed for user root Jul 17 19:31:14 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:14 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:14 devstack sudo[77407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 19:31:14 devstack sudo[77407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:31:14 devstack sudo[77407]: pam_unix(sudo:session): session closed for user root Jul 17 19:31:14 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.337s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:14 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:14 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:14 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:14 devstack sudo[77496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 19:31:14 devstack sudo[77496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:31:14 devstack sudo[77496]: pam_unix(sudo:session): session closed for user root Jul 17 19:31:14 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:14 devstack cinder-volume[76699]: INFO cinder.volume.drivers.lvm [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 17 19:31:14 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:14 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:14 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:14 devstack sudo[77501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 19:31:14 devstack sudo[77501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:31:14 devstack sudo[77501]: pam_unix(sudo:session): session closed for user root Jul 17 19:31:14 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:14 devstack cinder-volume[76699]: DEBUG cinder.volume.drivers.lvm [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Updating volume stats {{(pid=76699) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 19:31:14 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:14 devstack sudo[77510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 19:31:14 devstack sudo[77510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:31:15 devstack sudo[77510]: pam_unix(sudo:session): session closed for user root Jul 17 19:31:15 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:15 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:15 devstack sudo[77513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 19:31:15 devstack sudo[77513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:31:15 devstack sudo[77513]: pam_unix(sudo:session): session closed for user root Jul 17 19:31:15 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:15 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:15 devstack sudo[77516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 19:31:15 devstack sudo[77516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:31:15 devstack sudo[77516]: pam_unix(sudo:session): session closed for user root Jul 17 19:31:15 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:15 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:15 devstack sudo[77519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 19:31:15 devstack sudo[77519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:31:15 devstack sudo[77519]: pam_unix(sudo:session): session closed for user root Jul 17 19:31:16 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:16 devstack cinder-volume[76699]: INFO cinder.volume.driver [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Driver hasn't implemented _init_vendor_properties() Jul 17 19:31:16 devstack cinder-volume[76699]: DEBUG cinder.volume.driver [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76699) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 17 19:31:16 devstack cinder-volume[76699]: DEBUG oslo_db.sqlalchemy.engines [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76699) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 19:31:16 devstack cinder-volume[76699]: DEBUG dbcounter [-] [76699] Writer thread running {{(pid=76699) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 17 19:31:16 devstack cinder-volume[76699]: DEBUG cinder.db.api [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Building query based on filter {{(pid=76699) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 17 19:31:16 devstack cinder-volume[76699]: DEBUG cinder.image.image_utils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76699) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 17 19:31:16 devstack cinder-volume[76699]: INFO cinder.keymgr.migration [None req-348af7e7-8b31-4420-b0fe-76f5ef130e32 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 17 19:31:16 devstack cinder-volume[76699]: DEBUG cinder.volume.drivers.lvm [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Updating volume stats {{(pid=76699) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 19:31:16 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:16 devstack sudo[77523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 19:31:16 devstack sudo[77523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:31:16 devstack sudo[77523]: pam_unix(sudo:session): session closed for user root Jul 17 19:31:16 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:16 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:16 devstack sudo[77527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 19:31:16 devstack sudo[77527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:31:16 devstack sudo[77527]: pam_unix(sudo:session): session closed for user root Jul 17 19:31:16 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:16 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:16 devstack sudo[77532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 19:31:16 devstack sudo[77532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:31:16 devstack sudo[77532]: pam_unix(sudo:session): session closed for user root Jul 17 19:31:16 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:16 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:16 devstack sudo[77535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 19:31:16 devstack sudo[77535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:31:17 devstack sudo[77535]: pam_unix(sudo:session): session closed for user root Jul 17 19:31:17 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:17 devstack cinder-volume[76699]: DEBUG cinder.manager [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Notifying Schedulers of capabilities ... {{(pid=76699) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:31:17 devstack cinder-volume[76699]: INFO cinder.volume.manager [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Driver initialization completed successfully. Jul 17 19:31:17 devstack cinder-volume[76699]: INFO cinder.manager [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Initiating service 2 cleanup Jul 17 19:31:17 devstack cinder-volume[76699]: INFO cinder.manager [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Service 2 cleanup completed. Jul 17 19:31:17 devstack cinder-volume[76699]: DEBUG cinder.service [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Creating RPC server for service cinder-volume {{(pid=76699) start /opt/stack/cinder/cinder/service.py:231}} Jul 17 19:31:17 devstack cinder-volume[76699]: DEBUG cinder.service [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76699) start /opt/stack/cinder/cinder/service.py:237}} Jul 17 19:31:17 devstack cinder-volume[76699]: INFO cinder.volume.manager [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 17 19:31:17 devstack cinder-volume[76699]: DEBUG cinder.volume.drivers.lvm [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Updating volume stats {{(pid=76699) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 19:31:17 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:17 devstack sudo[77540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 19:31:17 devstack sudo[77540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:31:17 devstack sudo[77540]: pam_unix(sudo:session): session closed for user root Jul 17 19:31:17 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:17 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:17 devstack sudo[77543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 19:31:17 devstack sudo[77543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:31:17 devstack sudo[77543]: pam_unix(sudo:session): session closed for user root Jul 17 19:31:17 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:17 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:17 devstack sudo[77546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 19:31:17 devstack sudo[77546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:31:18 devstack sudo[77546]: pam_unix(sudo:session): session closed for user root Jul 17 19:31:18 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:18 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:31:18 devstack sudo[77552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 19:31:18 devstack sudo[77552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:31:18 devstack sudo[77552]: pam_unix(sudo:session): session closed for user root Jul 17 19:31:18 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:31:18 devstack cinder-volume[76699]: INFO cinder.volume.manager [None req-cb19c7f7-67df-4e7e-ae1b-1f244e9296e5 None None] Driver post RPC initialization completed successfully. Jul 17 19:31:20 devstack cinder-volume[76547]: DEBUG dbcounter [-] [76547] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:31:27 devstack cinder-volume[76699]: DEBUG dbcounter [-] [76699] Writing DB stats cinder:SELECT=1 {{(pid=76699) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:31:28 devstack cinder-volume[76699]: DEBUG dbcounter [-] [76699] Writing DB stats cinder:SELECT=13,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76699) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:32:07 devstack cinder-volume[76699]: DEBUG oslo_service.periodic_task [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] Running periodic task VolumeManager._thread_info {{(pid=76699) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:32:07 devstack cinder-volume[76699]: DEBUG cinder.volume.manager [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] thread count: 6 {{(pid=76699) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 19:32:07 devstack cinder-volume[76699]: DEBUG cinder.volume.manager [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] thread info: [<_MainThread(MainThread, started 133202308071552)>, , , , , ] {{(pid=76699) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 19:33:07 devstack cinder-volume[76699]: DEBUG oslo_service.periodic_task [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76699) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:33:07 devstack cinder-volume[76699]: DEBUG cinder.volume.drivers.lvm [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] Updating volume stats {{(pid=76699) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 19:33:07 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:33:07 devstack sudo[82777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 19:33:07 devstack sudo[82777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:33:07 devstack sudo[82777]: pam_unix(sudo:session): session closed for user root Jul 17 19:33:07 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:33:07 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:33:07 devstack sudo[82780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 19:33:07 devstack sudo[82780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:33:08 devstack sudo[82780]: pam_unix(sudo:session): session closed for user root Jul 17 19:33:08 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:33:08 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:33:08 devstack sudo[82783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 19:33:08 devstack sudo[82783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:33:08 devstack sudo[82783]: pam_unix(sudo:session): session closed for user root Jul 17 19:33:08 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:33:08 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:33:08 devstack sudo[82786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 19:33:08 devstack sudo[82786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:33:08 devstack sudo[82786]: pam_unix(sudo:session): session closed for user root Jul 17 19:33:08 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:33:08 devstack cinder-volume[76699]: DEBUG cinder.manager [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] Notifying Schedulers of capabilities ... {{(pid=76699) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:33:08 devstack cinder-volume[76699]: DEBUG oslo_service.periodic_task [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] Running periodic task VolumeManager._thread_info {{(pid=76699) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:33:08 devstack cinder-volume[76699]: DEBUG cinder.volume.manager [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] thread count: 6 {{(pid=76699) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 19:33:08 devstack cinder-volume[76699]: DEBUG cinder.volume.manager [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] thread info: [<_MainThread(MainThread, started 133202308071552)>, , , , , ] {{(pid=76699) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 19:33:28 devstack cinder-volume[76699]: DEBUG dbcounter [-] [76699] Writing DB stats cinder:SELECT=1 {{(pid=76699) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:33:28 devstack cinder-volume[76699]: DEBUG dbcounter [-] [76699] Writing DB stats cinder:UPDATE=1 {{(pid=76699) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:34:07 devstack cinder-volume[76699]: DEBUG oslo_service.periodic_task [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76699) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:34:07 devstack cinder-volume[76699]: DEBUG cinder.volume.drivers.lvm [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] Updating volume stats {{(pid=76699) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 19:34:07 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:34:07 devstack sudo[84440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 19:34:07 devstack sudo[84440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:34:07 devstack sudo[84440]: pam_unix(sudo:session): session closed for user root Jul 17 19:34:07 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:34:07 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:34:07 devstack sudo[84447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 19:34:07 devstack sudo[84447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:34:08 devstack sudo[84447]: pam_unix(sudo:session): session closed for user root Jul 17 19:34:08 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:34:08 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:34:08 devstack sudo[84466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 19:34:08 devstack sudo[84466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:34:08 devstack sudo[84466]: pam_unix(sudo:session): session closed for user root Jul 17 19:34:08 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:34:08 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:34:08 devstack sudo[84475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 19:34:08 devstack sudo[84475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:34:08 devstack sudo[84475]: pam_unix(sudo:session): session closed for user root Jul 17 19:34:08 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:34:08 devstack cinder-volume[76699]: DEBUG cinder.manager [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] Notifying Schedulers of capabilities ... {{(pid=76699) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:35:07 devstack cinder-volume[76699]: DEBUG oslo_service.periodic_task [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76699) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:35:07 devstack cinder-volume[76699]: DEBUG cinder.volume.drivers.lvm [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] Updating volume stats {{(pid=76699) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 19:35:07 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:35:07 devstack sudo[85819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 19:35:07 devstack sudo[85819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:35:07 devstack sudo[85819]: pam_unix(sudo:session): session closed for user root Jul 17 19:35:07 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:35:07 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:35:07 devstack sudo[85825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 19:35:07 devstack sudo[85825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:35:07 devstack sudo[85825]: pam_unix(sudo:session): session closed for user root Jul 17 19:35:07 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:35:07 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:35:08 devstack sudo[85828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 19:35:08 devstack sudo[85828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:35:08 devstack sudo[85828]: pam_unix(sudo:session): session closed for user root Jul 17 19:35:08 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:35:08 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:35:08 devstack sudo[85832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 19:35:08 devstack sudo[85832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:35:08 devstack sudo[85832]: pam_unix(sudo:session): session closed for user root Jul 17 19:35:08 devstack cinder-volume[76699]: DEBUG oslo_concurrency.processutils [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:35:08 devstack cinder-volume[76699]: DEBUG cinder.manager [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] Notifying Schedulers of capabilities ... {{(pid=76699) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:35:08 devstack cinder-volume[76699]: DEBUG oslo_service.periodic_task [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] Running periodic task VolumeManager._thread_info {{(pid=76699) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:35:08 devstack cinder-volume[76699]: DEBUG cinder.volume.manager [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] thread count: 6 {{(pid=76699) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 19:35:08 devstack cinder-volume[76699]: DEBUG cinder.volume.manager [None req-0dea9758-843a-4298-8412-2e1d6e000a4e None None] thread info: [<_MainThread(MainThread, started 133202308071552)>, , , , , ] {{(pid=76699) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 19:35:28 devstack cinder-volume[76699]: DEBUG dbcounter [-] [76699] Writing DB stats cinder:SELECT=1 {{(pid=76699) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:35:28 devstack cinder-volume[76699]: DEBUG dbcounter [-] [76699] Writing DB stats cinder:UPDATE=1 {{(pid=76699) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:35:48 devstack cinder-volume[76547]: INFO oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Caught SIGTERM, stopping children Jul 17 19:35:48 devstack cinder-volume[76547]: DEBUG oslo_concurrency.lockutils [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Acquiring lock "singleton_lock" {{(pid=76547) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 19:35:48 devstack cinder-volume[76547]: DEBUG oslo_concurrency.lockutils [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Acquired lock "singleton_lock" {{(pid=76547) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 19:35:48 devstack cinder-volume[76547]: DEBUG oslo_concurrency.lockutils [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Releasing lock "singleton_lock" {{(pid=76547) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 19:35:48 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Stop services. {{(pid=76547) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 17 19:35:48 devstack cinder-volume[76547]: DEBUG oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Killing children. {{(pid=76547) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 17 19:35:48 devstack cinder-volume[76547]: INFO oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Waiting on 1 children to exit Jul 17 19:35:52 devstack cinder-volume[76699]: DEBUG oslo_concurrency.lockutils [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Acquiring lock "singleton_lock" {{(pid=76699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 19:35:52 devstack cinder-volume[76699]: DEBUG oslo_concurrency.lockutils [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Acquired lock "singleton_lock" {{(pid=76699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 19:35:52 devstack cinder-volume[76699]: DEBUG oslo_concurrency.lockutils [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Releasing lock "singleton_lock" {{(pid=76699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 19:35:52 devstack cinder-volume[76699]: WARNING amqp [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 17 19:35:52 devstack cinder-volume[76699]: WARNING amqp [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 17 19:35:52 devstack cinder-volume[76547]: INFO oslo_service.backend._eventlet.service [None req-7d9b7d3b-7093-4937-8e9f-06c455230198 None None] Child 76699 exited with status 0 Jul 17 19:35:52 devstack cinder-volume[86801]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 17 19:35:52 devstack cinder-volume[86801]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 17 19:35:52 devstack cinder-volume[86801]: we strongly recommend against using it for new projects. Jul 17 19:35:52 devstack cinder-volume[86801]: If you are already using Eventlet, we recommend migrating to a different Jul 17 19:35:52 devstack cinder-volume[86801]: framework. For more detail see Jul 17 19:35:52 devstack cinder-volume[86801]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 17 19:35:52 devstack cinder-volume[86801]: import eventlet # noqa Jul 17 19:35:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86801) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 19:35:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86801) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 19:35:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86801) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 19:35:55 devstack cinder-volume[86801]: INFO dbcounter [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] Registered counter for database cinder Jul 17 19:35:55 devstack cinder-volume[86801]: DEBUG oslo_db.sqlalchemy.engines [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86801) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 19:35:55 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writer thread running {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 17 19:35:55 devstack cinder-volume[86801]: INFO cinder.rpc [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 17 19:35:55 devstack cinder-volume[86801]: INFO cinder.rpc [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_db.sqlalchemy.engines [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86801) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 19:35:56 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] Determined volume DB was empty at startup. Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86801) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 17 19:35:56 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 17 19:35:56 devstack cinder-volume[86801]: WARNING stevedore.named [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 17 19:35:56 devstack cinder-volume[86801]: WARNING castellan.key_manager [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 19:35:56 devstack cinder-volume[86801]: WARNING cinder.keymgr.conf_key_mgr [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 19:35:56 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_db.sqlalchemy.engines [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86801) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 19:35:56 devstack cinder-volume[86801]: INFO oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] Starting 1 workers Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] Started child 87025 {{(pid=86801) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] Full set of CONF: {{(pid=86801) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] ******************************************************************************** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] Configuration options gathered from: {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] ================================================================================ {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] allow_availability_zone_fallback = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] allow_compression_on_image_upload = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] allowed_direct_url_schemes = [] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] api_rate_limit = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[87025]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] auth_strategy = keystone {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_availability_zone = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_host = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_name = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_stats_polling_interval = 60 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backup_api_class = cinder.backup.api.API {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backup_name_template = backup-%s {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backup_use_same_host = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backup_use_temp_snapshot = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] chap_password = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] chap_username = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cinder_internal_tenant_project_id = 2af132a92b524df98f4c58e35cbe68bd {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cinder_internal_tenant_user_id = a4b660f49bc14e15bbe22a25a5642f4c {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cluster = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] compression_format = gzip {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] compute_api_class = cinder.compute.nova.API {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] config_dir = [] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] config_source = [] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] control_exchange = openstack {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] debug = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] default_availability_zone = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] default_group_type = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] default_volume_type = QuobyteHD {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] disk_geometry = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] driver_client_cert = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] driver_client_cert_key = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] driver_data_namespace = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] driver_ssl_cert_path = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] driver_ssl_cert_verify = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] driver_use_ssl = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] enable_new_services = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] enable_unsupported_driver = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] enabled_backends = ['QuobyteHD'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] enforce_multipath_for_image_xfer = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] filter_function = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] glance_api_insecure = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] glance_api_servers = ['http://192.168.122.254/image'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] glance_api_ssl_compression = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] glance_ca_certificates_file = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] glance_catalog_info = image:glance:publicURL {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] glance_certfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] glance_keyfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] glance_num_retries = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] glance_request_timeout = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] goodness_function = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] graceful_shutdown_timeout = 5 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] group_api_class = cinder.group.api.API {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] host = devstack {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] image_compress_on_upload = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] image_conversion_address_space_limit = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] image_conversion_cpu_limit = 60 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] image_conversion_disable = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] image_upload_use_cinder_backend = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] image_upload_use_internal_tenant = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] image_volume_cache_enabled = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] image_volume_cache_max_count = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] image_volume_cache_max_size_gb = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] init_host_max_objects_retrieval = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] instance_format = [instance: %(uuid)s] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] iscsi_target_flags = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] iscsi_write_cache = on {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] iser_helper = tgtadm {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] iser_ip_address = 192.168.122.254 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] iser_port = 3260 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[87025]: INFO cinder.volume.manager [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Starting volume driver QuobyteDriver (1.2) Jul 17 19:35:56 devstack cinder-volume[87025]: DEBUG cinder.volume.drivers.remotefs [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87025) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] log_color = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] log_config_append = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] log_dir = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] log_file = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] log_options = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] log_rotate_interval = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] log_rotate_interval_type = days {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] log_rotation_type = none {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] max_age = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] max_logfile_count = 30 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] max_logfile_size_mb = 200 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] max_over_subscription_ratio = 20.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] message_reap_interval = 86400 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] message_ttl = 2592000 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] migration_create_volume_timeout_secs = 300 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] monkey_patch = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] monkey_patch_modules = [] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] my_ip = 192.168.122.254 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] no_snapshot_gb_quota = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] num_iser_scan_tries = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] num_shell_tries = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] num_volume_device_scan_tries = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] nvmeof_conn_info_version = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] nvmet_ns_id = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] nvmet_port_id = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] osapi_max_limit = 1000 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] osapi_volume_ext_list = [] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] osapi_volume_listen_port = 8776 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] osapi_volume_use_ssl = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] osapi_volume_workers = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] per_volume_size_limit = -1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] periodic_fuzzy_delay = 60 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] periodic_interval = 60 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] public_endpoint = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] publish_errors = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] quota_backup_gigabytes = 1000 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] quota_backups = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] quota_gigabytes = 1000 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] quota_groups = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] quota_snapshots = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] quota_volumes = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] rate_limit_burst = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] rate_limit_except_level = CRITICAL {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] rate_limit_interval = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] reinit_driver_count = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] replication_device = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] report_discard_supported = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] report_interval = 120 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] reservation_clean_interval = 86400 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] reservation_expire = 86400 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] reserved_image_namespaces = [] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] reserved_percentage = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] rpc_response_timeout = 120 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] run_external_periodic_tasks = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] scst_target_driver = iscsi {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] scst_target_iqn_name = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] service_down_time = 720 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] shell_completion = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] snapshot_name_template = snapshot-%s {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] split_loggers = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] state_path = /opt/stack/data/cinder {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] storage_availability_zone = nova {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] storage_protocol = iSCSI {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] syslog_log_facility = LOG_USER {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] target_helper = lioadm {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] target_ip_address = 192.168.122.254 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] target_port = 3260 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] target_protocol = iscsi {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] target_secondary_ip_addresses = [] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] trace_flags = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] transport_url = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] until_refresh = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] use_chap_auth = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] use_default_quota_class = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] use_journal = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] use_json = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] use_multipath_for_image_xfer = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] use_stderr = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] use_syslog = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] verify_glance_signatures = enabled {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] volume_api_class = cinder.volume.api.API {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] volume_backend_name = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] volume_clear = zero {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] volume_clear_ionice = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] volume_clear_size = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] volume_copy_bps_limit = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] volume_dd_blocksize = 1M {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] volume_name_template = volume-%s {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] volume_service_inithost_offload = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[87025]: DEBUG cinder.volume.drivers.quobyte [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87025) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 17 19:35:56 devstack cinder-volume[87025]: WARNING cinder.volume.drivers.quobyte [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 17 19:35:56 devstack cinder-volume[87025]: WARNING cinder.volume.drivers.quobyte [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] volume_usage_audit_period = month {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[87025]: DEBUG oslo_concurrency.processutils [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Running cmd (subprocess): mount.quobyte {{(pid=87025) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] zoning_mode = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_concurrency.disable_process_locking = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.auth_section = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.auth_type = password {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.auth_version = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.cache = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.certfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.include_service_catalog = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.insecure = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.interface = public {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.keyfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.memcache_password = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.memcache_username = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.region_name = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.service_type = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.254/identity {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.backend = dogpile.cache.null {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.backend_argument = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.backend_expiration_time = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.config_prefix = cache.oslo {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.debug_cache_backend = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.enable_retry_client = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.enable_socket_keepalive = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.enabled = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.expiration_time = 600 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.hashclient_retry_attempts = 2 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.memcache_dead_retry = 300 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.memcache_pool_maxsize = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.memcache_sasl_enabled = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.password = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.proxies = [] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.redis_db = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.redis_server = localhost:6379 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.retry_attempts = 2 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.retry_delay = 0.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.socket_keepalive_count = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.socket_keepalive_idle = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.socket_keepalive_interval = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.socket_timeout = 1.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.tls_allowed_ciphers = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.tls_cafile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.tls_certfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.tls_enabled = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.tls_keyfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cache.username = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] coordination.backend_url = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] database.asyncio_connection = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] database.asyncio_slave_connection = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] database.backend = sqlalchemy {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] database.connection = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] database.connection_debug = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] database.connection_parameters = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] database.connection_recycle_time = 3600 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] database.connection_trace = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] database.db_inc_retry_interval = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] database.db_max_retries = 20 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] database.db_max_retry_interval = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] database.db_retry_interval = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] database.max_overflow = 50 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] database.max_pool_size = 5 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] database.max_retries = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] database.mysql_wsrep_sync_wait = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] database.pool_timeout = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] database.retry_interval = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] database.slave_connection = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] database.sqlite_synchronous = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] database.synchronous_reader = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack quobyte-client[87028]: Reading configuration file: /etc/quobyte/client.cfg Jul 17 19:35:56 devstack quobyte-client[87028]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] database.use_db_reconnect = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[87025]: DEBUG oslo_concurrency.processutils [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] CMD "mount.quobyte" returned: 1 in 0.082s {{(pid=87025) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:35:56 devstack cinder-volume[87025]: DEBUG oslo_concurrency.lockutils [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87025) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:35:56 devstack cinder-volume[87025]: DEBUG oslo_concurrency.lockutils [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87025) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:35:56 devstack cinder-volume[87025]: DEBUG cinder.volume.drivers.quobyte [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87025) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] profiler.connection_string = messaging:// {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] profiler.enabled = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[87025]: INFO cinder.volume.drivers.quobyte [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 ... Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] profiler.es_doc_type = notification {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] profiler.es_scroll_size = 10000 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[87025]: DEBUG oslo_concurrency.processutils [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 -c /etc/quobyte/client-cinder.cfg {{(pid=87025) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] profiler.es_scroll_time = 2m {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] profiler.filter_error_trace = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] profiler.hmac_keys = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] profiler.sentinel_service_name = mymaster {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] profiler.socket_timeout = 0.1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] profiler.trace_requests = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] profiler.trace_sqlalchemy = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] profiler_jaeger.process_tags = {} {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] profiler_jaeger.service_name_prefix = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] profiler_otlp.service_name_prefix = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_policy.enforce_new_defaults = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_policy.policy_default_rule = default {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_policy.policy_file = policy.yaml {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] privsep_osbrick.group = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] privsep_osbrick.helper_command = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] privsep_osbrick.user = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cinder_sys_admin.group = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cinder_sys_admin.helper_command = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] cinder_sys_admin.user = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] service_user.auth_section = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] service_user.auth_type = password {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] service_user.cafile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] service_user.certfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack sudo[87031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 -c /etc/quobyte/client-cinder.cfg Jul 17 19:35:56 devstack sudo[87031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] service_user.collect_timing = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] service_user.insecure = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] service_user.keyfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] service_user.send_service_user_token = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] service_user.split_loggers = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] service_user.timeout = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] glance.auth_section = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] glance.auth_type = password {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] glance.certfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] glance.collect_timing = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] glance.insecure = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] glance.keyfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] glance.region_name = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] glance.split_loggers = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] glance.timeout = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.backend_availability_zone = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.chap_password = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.chap_username = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.disk_geometry = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.driver_client_cert = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.driver_client_cert_key = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.driver_data_namespace = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.driver_use_ssl = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.extra_capabilities = {} {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.filter_function = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.goodness_function = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.iscsi_target_flags = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.iscsi_write_cache = on {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.iser_helper = tgtadm {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.iser_ip_address = 192.168.122.254 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.iser_port = 3260 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.nas_host = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.nas_login = admin {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.nas_mount_options = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.nas_password = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.nas_private_key = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.nas_share_path = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.num_shell_tries = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.quobyte_volume_url = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.replication_device = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.report_discard_supported = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.reserved_percentage = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.target_helper = tgtadm {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.target_ip_address = 192.168.122.254 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.target_port = 3260 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.target_protocol = iscsi {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.trace_flags = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.unique_fqdn_network = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.use_chap_auth = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.volume_backend_name = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.volume_clear = zero {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.volume_clear_ionice = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.volume_clear_size = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_reports.file_event_handler = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_reports.log_dir = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.backend_availability_zone = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.backend_host = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.chap_password = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.chap_username = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.chiscsi_conf = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.disk_geometry = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.driver_client_cert = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.driver_data_namespace = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.driver_use_ssl = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.extra_capabilities = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.filter_function = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.goodness_function = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.iser_helper = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.iser_ip_address = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.iser_port = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.iser_target_prefix = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.nas_host = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.nas_login = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.nas_mount_options = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.nas_password = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.nas_private_key = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.nas_share_path = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.nas_ssh_port = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.num_shell_tries = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.nvmet_port_id = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.replication_device = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.report_discard_supported = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.reserved_percentage = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.scst_target_driver = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.storage_protocol = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.target_helper = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.target_ip_address = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.target_port = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.target_prefix = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.target_protocol = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.trace_flags = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.use_chap_auth = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.volume_clear = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.volume_clear_size = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] QuobyteHD.volumes_dir = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.ssl = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_notifications.driver = [] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_notifications.retry = -1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] key_manager.fixed_key = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] barbican.barbican_api_version = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] barbican.barbican_endpoint = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] barbican.barbican_endpoint_type = public {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] barbican.barbican_region_name = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] barbican.cafile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] barbican.certfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] barbican.collect_timing = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] barbican.insecure = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] barbican.keyfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] barbican.number_of_retries = 60 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] barbican.retry_delay = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] barbican.send_service_user_token = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] barbican.split_loggers = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] barbican.timeout = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] barbican.verify_ssl = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] barbican.verify_ssl_path = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] barbican_service_user.auth_section = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] barbican_service_user.auth_type = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] barbican_service_user.cafile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] barbican_service_user.certfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] barbican_service_user.collect_timing = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] barbican_service_user.insecure = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] barbican_service_user.keyfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] barbican_service_user.split_loggers = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] barbican_service_user.timeout = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] vault.approle_role_id = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] vault.approle_secret_id = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] vault.auth_method = approle {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] vault.auth_path = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] vault.kv_mountpoint = secret {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] vault.kv_path = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] vault.kv_version = 2 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] vault.namespace = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] vault.root_token_id = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] vault.ssl_ca_crt_file = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] vault.timeout = 60.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] vault.token_file = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] vault.token_role = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] vault.use_ssl = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:35:56 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] ******************************************************************************** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 17 19:35:56 devstack sudo[87031]: pam_unix(sudo:session): session closed for user root Jul 17 19:35:56 devstack cinder-volume[87025]: DEBUG oslo_concurrency.processutils [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.424s {{(pid=87025) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:35:56 devstack cinder-volume[87025]: INFO cinder.volume.drivers.quobyte [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 succeeded Jul 17 19:35:56 devstack cinder-volume[87025]: DEBUG cinder.volume.drivers.quobyte [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87025) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:35:56 devstack cinder-volume[87025]: DEBUG oslo_concurrency.lockutils [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.439s {{(pid=87025) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:35:56 devstack cinder-volume[87025]: DEBUG oslo_concurrency.processutils [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87025) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:35:56 devstack sudo[87100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:35:56 devstack sudo[87100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:35:57 devstack sudo[87100]: pam_unix(sudo:session): session closed for user root Jul 17 19:35:57 devstack cinder-volume[87025]: DEBUG oslo_concurrency.processutils [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.245s {{(pid=87025) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:35:57 devstack cinder-volume[87025]: INFO cinder.volume.driver [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Driver hasn't implemented _init_vendor_properties() Jul 17 19:35:57 devstack cinder-volume[87025]: DEBUG cinder.volume.driver [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.744571685791, 'free_capacity_gb': 1775.744571685791, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87025) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 17 19:35:57 devstack cinder-volume[87025]: DEBUG oslo_db.sqlalchemy.engines [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87025) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 19:35:57 devstack cinder-volume[87025]: DEBUG dbcounter [-] [87025] Writer thread running {{(pid=87025) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 17 19:35:57 devstack cinder-volume[87025]: DEBUG cinder.db.api [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Building query based on filter {{(pid=87025) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 17 19:35:57 devstack cinder-volume[87025]: DEBUG cinder.image.image_utils [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87025) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 17 19:35:57 devstack cinder-volume[87025]: INFO cinder.keymgr.migration [None req-76cae3e5-0c41-4284-b4f8-031f184c4d10 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 17 19:35:57 devstack cinder-volume[87025]: DEBUG oslo_concurrency.lockutils [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87025) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:35:57 devstack cinder-volume[87025]: DEBUG oslo_concurrency.lockutils [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87025) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:35:57 devstack cinder-volume[87025]: DEBUG cinder.volume.drivers.quobyte [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87025) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:35:57 devstack cinder-volume[87025]: DEBUG cinder.volume.drivers.quobyte [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87025) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:35:57 devstack cinder-volume[87025]: DEBUG oslo_concurrency.lockutils [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87025) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:35:57 devstack cinder-volume[87025]: DEBUG oslo_concurrency.processutils [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87025) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:35:57 devstack sudo[87103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:35:57 devstack sudo[87103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:35:57 devstack sudo[87103]: pam_unix(sudo:session): session closed for user root Jul 17 19:35:57 devstack cinder-volume[87025]: DEBUG oslo_concurrency.processutils [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.227s {{(pid=87025) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:35:57 devstack cinder-volume[87025]: DEBUG cinder.manager [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Notifying Schedulers of capabilities ... {{(pid=87025) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:35:57 devstack cinder-volume[87025]: INFO cinder.volume.manager [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Driver initialization completed successfully. Jul 17 19:35:57 devstack cinder-volume[87025]: INFO cinder.manager [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Initiating service 3 cleanup Jul 17 19:35:57 devstack cinder-volume[87025]: INFO cinder.manager [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Service 3 cleanup completed. Jul 17 19:35:57 devstack cinder-volume[87025]: DEBUG cinder.service [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Creating RPC server for service cinder-volume {{(pid=87025) start /opt/stack/cinder/cinder/service.py:231}} Jul 17 19:35:57 devstack cinder-volume[87025]: DEBUG cinder.service [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87025) start /opt/stack/cinder/cinder/service.py:237}} Jul 17 19:35:57 devstack cinder-volume[87025]: INFO cinder.volume.manager [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 17 19:35:57 devstack cinder-volume[87025]: DEBUG oslo_concurrency.lockutils [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87025) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:35:57 devstack cinder-volume[87025]: DEBUG oslo_concurrency.lockutils [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87025) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:35:57 devstack cinder-volume[87025]: DEBUG cinder.volume.drivers.quobyte [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87025) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:35:57 devstack cinder-volume[87025]: DEBUG cinder.volume.drivers.quobyte [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87025) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:35:57 devstack cinder-volume[87025]: DEBUG oslo_concurrency.lockutils [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87025) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:35:57 devstack cinder-volume[87025]: DEBUG oslo_concurrency.processutils [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87025) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:35:57 devstack sudo[87123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:35:57 devstack sudo[87123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:35:58 devstack sudo[87123]: pam_unix(sudo:session): session closed for user root Jul 17 19:35:58 devstack cinder-volume[87025]: DEBUG oslo_concurrency.processutils [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.402s {{(pid=87025) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:35:58 devstack cinder-volume[87025]: INFO cinder.volume.manager [None req-5b298574-b290-417d-97fe-bcebe3d355d1 None None] Driver post RPC initialization completed successfully. Jul 17 19:36:02 devstack cinder-volume[87025]: DEBUG oslo_concurrency.lockutils [None req-a49b6cee-fda5-4a18-bf72-659e08cca08b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87025) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:36:02 devstack cinder-volume[87025]: DEBUG oslo_concurrency.lockutils [None req-a49b6cee-fda5-4a18-bf72-659e08cca08b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87025) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:36:02 devstack cinder-volume[87025]: DEBUG cinder.volume.drivers.quobyte [None req-a49b6cee-fda5-4a18-bf72-659e08cca08b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87025) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:36:02 devstack cinder-volume[87025]: DEBUG cinder.volume.drivers.quobyte [None req-a49b6cee-fda5-4a18-bf72-659e08cca08b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87025) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:36:02 devstack cinder-volume[87025]: DEBUG oslo_concurrency.lockutils [None req-a49b6cee-fda5-4a18-bf72-659e08cca08b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87025) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:36:02 devstack cinder-volume[87025]: DEBUG oslo_concurrency.processutils [None req-a49b6cee-fda5-4a18-bf72-659e08cca08b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87025) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:36:02 devstack sudo[87299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:36:02 devstack sudo[87299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:36:02 devstack sudo[87299]: pam_unix(sudo:session): session closed for user root Jul 17 19:36:02 devstack cinder-volume[87025]: DEBUG oslo_concurrency.processutils [None req-a49b6cee-fda5-4a18-bf72-659e08cca08b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.264s {{(pid=87025) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:36:02 devstack cinder-volume[87025]: DEBUG cinder.manager [None req-a49b6cee-fda5-4a18-bf72-659e08cca08b None None] Notifying Schedulers of capabilities ... {{(pid=87025) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:36:02 devstack cinder-volume[86801]: INFO oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] Caught SIGTERM, stopping children Jul 17 19:36:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] Acquiring lock "singleton_lock" {{(pid=86801) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 19:36:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] Acquired lock "singleton_lock" {{(pid=86801) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 19:36:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] Releasing lock "singleton_lock" {{(pid=86801) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 19:36:02 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] Stop services. {{(pid=86801) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 17 19:36:02 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] Killing children. {{(pid=86801) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 17 19:36:02 devstack cinder-volume[86801]: INFO oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] Waiting on 1 children to exit Jul 17 19:36:05 devstack cinder-volume[87025]: DEBUG oslo_concurrency.lockutils [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] Acquiring lock "singleton_lock" {{(pid=87025) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 19:36:05 devstack cinder-volume[87025]: DEBUG oslo_concurrency.lockutils [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] Acquired lock "singleton_lock" {{(pid=87025) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 19:36:05 devstack cinder-volume[87025]: DEBUG oslo_concurrency.lockutils [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] Releasing lock "singleton_lock" {{(pid=87025) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 19:36:06 devstack cinder-volume[87025]: WARNING amqp [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 17 19:36:06 devstack cinder-volume[87025]: WARNING amqp [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 17 19:36:06 devstack cinder-volume[86801]: INFO oslo_service.backend._eventlet.service [None req-cb887f26-b890-4d9b-9674-5226cafc3ec7 None None] Child 87025 exited with status 0 Jul 17 19:36:06 devstack cinder-volume[87411]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 17 19:36:06 devstack cinder-volume[87411]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 17 19:36:06 devstack cinder-volume[87411]: we strongly recommend against using it for new projects. Jul 17 19:36:06 devstack cinder-volume[87411]: If you are already using Eventlet, we recommend migrating to a different Jul 17 19:36:06 devstack cinder-volume[87411]: framework. For more detail see Jul 17 19:36:06 devstack cinder-volume[87411]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 17 19:36:06 devstack cinder-volume[87411]: import eventlet # noqa Jul 17 19:36:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87411) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 19:36:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87411) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 19:36:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87411) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 19:36:10 devstack cinder-volume[87411]: INFO dbcounter [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] Registered counter for database cinder Jul 17 19:36:10 devstack cinder-volume[87411]: DEBUG oslo_db.sqlalchemy.engines [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87411) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 19:36:10 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writer thread running {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 17 19:36:10 devstack cinder-volume[87411]: INFO cinder.rpc [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 17 19:36:10 devstack cinder-volume[87411]: INFO cinder.rpc [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 17 19:36:10 devstack cinder-volume[87411]: DEBUG oslo_db.sqlalchemy.engines [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87411) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 19:36:10 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] Determined volume DB was empty at startup. Jul 17 19:36:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87411) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 17 19:36:10 devstack cinder-volume[87411]: WARNING stevedore.named [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 17 19:36:10 devstack cinder-volume[87411]: WARNING castellan.key_manager [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 19:36:10 devstack cinder-volume[87411]: WARNING cinder.keymgr.conf_key_mgr [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 19:36:10 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 17 19:36:10 devstack cinder-volume[87411]: DEBUG oslo_db.sqlalchemy.engines [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87411) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 19:36:10 devstack cinder-volume[87411]: INFO oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] Starting 1 workers Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] Started child 87726 {{(pid=87411) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] Full set of CONF: {{(pid=87411) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] ******************************************************************************** {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] Configuration options gathered from: {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] ================================================================================ {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] allow_availability_zone_fallback = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87726]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] allow_compression_on_image_upload = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] allowed_direct_url_schemes = [] {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] api_rate_limit = True {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] auth_strategy = keystone {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_availability_zone = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_host = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_name = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_stats_polling_interval = 60 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backup_api_class = cinder.backup.api.API {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backup_name_template = backup-%s {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backup_use_same_host = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backup_use_temp_snapshot = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] chap_password = **** {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] chap_username = {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cinder_internal_tenant_project_id = 2af132a92b524df98f4c58e35cbe68bd {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cinder_internal_tenant_user_id = a4b660f49bc14e15bbe22a25a5642f4c {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cluster = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] compression_format = gzip {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] compute_api_class = cinder.compute.nova.API {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] config_dir = [] {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] config_source = [] {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] control_exchange = openstack {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] debug = True {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] default_availability_zone = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] default_group_type = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] default_volume_type = QuobyteHD {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] disk_geometry = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] driver_client_cert = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] driver_client_cert_key = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] driver_data_namespace = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] driver_ssl_cert_path = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] driver_ssl_cert_verify = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] driver_use_ssl = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] enable_new_services = True {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] enable_unsupported_driver = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] enabled_backends = ['QuobyteHD'] {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] enforce_multipath_for_image_xfer = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] filter_function = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] glance_api_insecure = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] glance_api_servers = ['http://192.168.122.254/image'] {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] glance_api_ssl_compression = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] glance_ca_certificates_file = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] glance_catalog_info = image:glance:publicURL {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] glance_certfile = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] glance_keyfile = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] glance_num_retries = 3 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] glance_request_timeout = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] goodness_function = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] graceful_shutdown_timeout = 5 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] group_api_class = cinder.group.api.API {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] host = devstack {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] image_compress_on_upload = True {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] image_conversion_address_space_limit = 1 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] image_conversion_cpu_limit = 60 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] image_conversion_disable = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] image_upload_use_cinder_backend = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] image_upload_use_internal_tenant = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] image_volume_cache_enabled = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] image_volume_cache_max_count = 0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] image_volume_cache_max_size_gb = 0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] init_host_max_objects_retrieval = 0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] instance_format = [instance: %(uuid)s] {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] iscsi_target_flags = {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Starting volume driver QuobyteDriver (1.2) Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] iscsi_write_cache = on {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87726) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] iser_helper = tgtadm {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] iser_ip_address = 192.168.122.254 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] iser_port = 3260 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] log_color = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] log_config_append = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] log_dir = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] log_file = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] log_options = True {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] log_rotate_interval = 1 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] log_rotate_interval_type = days {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] log_rotation_type = none {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] max_age = 0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] max_logfile_count = 30 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] max_logfile_size_mb = 200 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] max_over_subscription_ratio = 20.0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] message_reap_interval = 86400 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] message_ttl = 2592000 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] migration_create_volume_timeout_secs = 300 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] monkey_patch = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] monkey_patch_modules = [] {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] my_ip = 192.168.122.254 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] no_snapshot_gb_quota = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] num_iser_scan_tries = 3 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] num_shell_tries = 3 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] num_volume_device_scan_tries = 3 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] nvmeof_conn_info_version = 1 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] nvmet_ns_id = 10 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] nvmet_port_id = 1 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] osapi_max_limit = 1000 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] osapi_volume_ext_list = [] {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] osapi_volume_listen_port = 8776 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] osapi_volume_use_ssl = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] osapi_volume_workers = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] per_volume_size_limit = -1 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] periodic_fuzzy_delay = 60 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] periodic_interval = 60 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] public_endpoint = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] publish_errors = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] quota_backup_gigabytes = 1000 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] quota_backups = 10 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] quota_gigabytes = 1000 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] quota_groups = 10 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] quota_snapshots = 10 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] quota_volumes = 10 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] rate_limit_burst = 0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] rate_limit_except_level = CRITICAL {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] rate_limit_interval = 0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] reinit_driver_count = 3 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] replication_device = **** {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] report_discard_supported = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] report_interval = 120 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] reservation_clean_interval = 86400 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] reservation_expire = 86400 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] reserved_image_namespaces = [] {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] reserved_percentage = 0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] rpc_response_timeout = 120 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] run_external_periodic_tasks = True {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] scst_target_driver = iscsi {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] scst_target_iqn_name = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] service_down_time = 720 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] shell_completion = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] snapshot_name_template = snapshot-%s {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] split_loggers = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] state_path = /opt/stack/data/cinder {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] storage_availability_zone = nova {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] storage_protocol = iSCSI {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] syslog_log_facility = LOG_USER {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] target_helper = lioadm {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] target_ip_address = 192.168.122.254 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] target_port = 3260 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] target_protocol = iscsi {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] target_secondary_ip_addresses = [] {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] trace_flags = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] transport_url = **** {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] until_refresh = 0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] use_chap_auth = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] use_default_quota_class = True {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] use_journal = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] use_json = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] use_multipath_for_image_xfer = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] use_stderr = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] use_syslog = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] verify_glance_signatures = enabled {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] volume_api_class = cinder.volume.api.API {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] volume_backend_name = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] volume_clear = zero {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] volume_clear_ionice = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] volume_clear_size = 0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] volume_copy_bps_limit = 0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] volume_dd_blocksize = 1M {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] volume_name_template = volume-%s {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] volume_service_inithost_offload = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] volume_usage_audit_period = month {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] zoning_mode = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_concurrency.disable_process_locking = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.auth_section = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.auth_type = password {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.auth_version = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.cache = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.certfile = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.include_service_catalog = True {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.insecure = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.interface = public {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.keyfile = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.memcache_password = {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.memcache_username = {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.region_name = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.service_type = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.254/identity {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.backend = dogpile.cache.null {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.backend_argument = **** {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.backend_expiration_time = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.config_prefix = cache.oslo {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.debug_cache_backend = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.enable_retry_client = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.enable_socket_keepalive = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.enabled = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.expiration_time = 600 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.hashclient_retry_attempts = 2 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.memcache_dead_retry = 300 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.memcache_pool_maxsize = 10 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.memcache_sasl_enabled = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.password = **** {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.proxies = [] {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.redis_db = 0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.redis_server = localhost:6379 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.retry_attempts = 2 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.retry_delay = 0.0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.socket_keepalive_count = 1 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.socket_keepalive_idle = 1 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.socket_keepalive_interval = 1 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.socket_timeout = 1.0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.tls_allowed_ciphers = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.tls_cafile = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.tls_certfile = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.tls_enabled = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.tls_keyfile = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cache.username = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] coordination.backend_url = **** {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] database.asyncio_connection = **** {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] database.asyncio_slave_connection = **** {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] database.backend = sqlalchemy {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] database.connection = **** {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] database.connection_debug = 0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] database.connection_parameters = {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] database.connection_recycle_time = 3600 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] database.connection_trace = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] database.db_inc_retry_interval = True {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] database.db_max_retries = 20 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] database.db_max_retry_interval = 10 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] database.db_retry_interval = 1 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] database.max_overflow = 50 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] database.max_pool_size = 5 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] database.max_retries = 10 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] database.mysql_wsrep_sync_wait = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] database.pool_timeout = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] database.retry_interval = 10 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] database.slave_connection = **** {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] database.sqlite_synchronous = True {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] database.synchronous_reader = True {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] database.use_db_reconnect = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] profiler.connection_string = messaging:// {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] profiler.enabled = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] profiler.es_doc_type = notification {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] profiler.es_scroll_size = 10000 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] profiler.es_scroll_time = 2m {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] profiler.filter_error_trace = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] profiler.hmac_keys = **** {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] profiler.sentinel_service_name = mymaster {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] profiler.socket_timeout = 0.1 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] profiler.trace_requests = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87726) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 17 19:36:11 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.quobyte [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 17 19:36:11 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.quobyte [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] profiler.trace_sqlalchemy = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] profiler_jaeger.process_tags = {} {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] profiler_jaeger.service_name_prefix = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] profiler_otlp.service_name_prefix = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_policy.enforce_new_defaults = True {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_policy.policy_default_rule = default {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Running cmd (subprocess): mount.quobyte {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_policy.policy_file = policy.yaml {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] privsep_osbrick.group = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] privsep_osbrick.helper_command = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] privsep_osbrick.user = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cinder_sys_admin.group = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cinder_sys_admin.helper_command = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] cinder_sys_admin.user = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] service_user.auth_section = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] service_user.auth_type = password {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] service_user.cafile = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] service_user.certfile = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] service_user.collect_timing = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] service_user.insecure = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] service_user.keyfile = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] service_user.send_service_user_token = True {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] service_user.split_loggers = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] service_user.timeout = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] glance.auth_section = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] glance.auth_type = password {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] glance.certfile = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] glance.collect_timing = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] glance.insecure = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] glance.keyfile = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] glance.region_name = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] glance.split_loggers = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] glance.timeout = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.backend_availability_zone = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.chap_password = **** {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.chap_username = {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.disk_geometry = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.driver_client_cert = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.driver_client_cert_key = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack quobyte-client[87727]: Reading configuration file: /etc/quobyte/client.cfg Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.driver_data_namespace = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.driver_use_ssl = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack quobyte-client[87727]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.extra_capabilities = {} {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.filter_function = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.goodness_function = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.iscsi_target_flags = {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.iscsi_write_cache = on {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.iser_helper = tgtadm {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.iser_ip_address = 192.168.122.254 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.iser_port = 3260 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] CMD "mount.quobyte" returned: 1 in 0.067s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:36:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:36:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.nas_host = {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.nas_login = admin {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.nas_mount_options = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.nas_password = **** {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.nas_private_key = {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.nas_share_path = {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:36:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:36:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.num_shell_tries = 3 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.quobyte_volume_url = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.replication_device = **** {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.report_discard_supported = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.reserved_percentage = 0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.target_helper = tgtadm {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.target_ip_address = 192.168.122.254 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.target_port = 3260 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.target_protocol = iscsi {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.trace_flags = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.unique_fqdn_network = True {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.use_chap_auth = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.volume_backend_name = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.volume_clear = zero {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.volume_clear_ionice = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack sudo[87731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.volume_clear_size = 0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack sudo[87731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_reports.file_event_handler = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_reports.log_dir = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.backend_availability_zone = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.backend_host = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.chap_password = **** {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.chap_username = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.chiscsi_conf = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.disk_geometry = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.driver_client_cert = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.driver_data_namespace = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.driver_use_ssl = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.extra_capabilities = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.filter_function = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.goodness_function = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.iser_helper = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.iser_ip_address = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.iser_port = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.iser_target_prefix = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.nas_host = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.nas_login = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.nas_mount_options = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.nas_password = **** {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.nas_private_key = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.nas_share_path = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.nas_ssh_port = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.num_shell_tries = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.nvmet_port_id = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.replication_device = **** {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.report_discard_supported = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.reserved_percentage = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.scst_target_driver = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.storage_protocol = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.target_helper = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.target_ip_address = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.target_port = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.target_prefix = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.target_protocol = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.trace_flags = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.use_chap_auth = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.volume_clear = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.volume_clear_size = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] QuobyteHD.volumes_dir = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.ssl = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_notifications.driver = [] {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_notifications.retry = -1 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] key_manager.fixed_key = **** {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] barbican.barbican_api_version = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] barbican.barbican_endpoint = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] barbican.barbican_endpoint_type = public {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] barbican.barbican_region_name = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] barbican.cafile = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] barbican.certfile = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] barbican.collect_timing = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] barbican.insecure = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] barbican.keyfile = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] barbican.number_of_retries = 60 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] barbican.retry_delay = 1 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] barbican.send_service_user_token = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] barbican.split_loggers = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] barbican.timeout = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] barbican.verify_ssl = True {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] barbican.verify_ssl_path = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] barbican_service_user.auth_section = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] barbican_service_user.auth_type = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] barbican_service_user.cafile = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] barbican_service_user.certfile = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] barbican_service_user.collect_timing = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] barbican_service_user.insecure = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] barbican_service_user.keyfile = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] barbican_service_user.split_loggers = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] barbican_service_user.timeout = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] vault.approle_role_id = **** {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] vault.approle_secret_id = **** {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] vault.auth_method = approle {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] vault.auth_path = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] vault.kv_mountpoint = secret {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] vault.kv_path = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] vault.kv_version = 2 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] vault.namespace = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] vault.root_token_id = **** {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] vault.ssl_ca_crt_file = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] vault.timeout = 60.0 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] vault.token_file = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] vault.token_role = None {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] vault.use_ssl = False {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 19:36:11 devstack cinder-volume[87411]: DEBUG oslo_service.backend._eventlet.service [None req-e01833c3-1b21-4505-9da0-39f6298542d1 None None] ******************************************************************************** {{(pid=87411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 17 19:36:11 devstack sudo[87731]: pam_unix(sudo:session): session closed for user root Jul 17 19:36:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.291s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:36:11 devstack cinder-volume[87726]: INFO cinder.volume.driver [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Driver hasn't implemented _init_vendor_properties() Jul 17 19:36:11 devstack cinder-volume[87726]: DEBUG cinder.volume.driver [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7513999938965, 'free_capacity_gb': 1775.7513999938965, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87726) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 17 19:36:11 devstack cinder-volume[87726]: DEBUG oslo_db.sqlalchemy.engines [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87726) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 19:36:11 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writer thread running {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 17 19:36:11 devstack cinder-volume[87726]: DEBUG cinder.db.api [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Building query based on filter {{(pid=87726) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 17 19:36:11 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87726) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 17 19:36:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:36:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:36:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:36:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:36:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:36:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:36:11 devstack cinder-volume[87726]: INFO cinder.keymgr.migration [None req-42d08e4d-d297-4c9c-bff9-484803242336 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 17 19:36:11 devstack sudo[87746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:36:11 devstack sudo[87746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:36:11 devstack sudo[87746]: pam_unix(sudo:session): session closed for user root Jul 17 19:36:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.227s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:36:11 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:36:11 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Driver initialization completed successfully. Jul 17 19:36:11 devstack cinder-volume[87726]: INFO cinder.manager [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Initiating service 3 cleanup Jul 17 19:36:11 devstack cinder-volume[87726]: INFO cinder.manager [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Service 3 cleanup completed. Jul 17 19:36:11 devstack cinder-volume[87726]: DEBUG cinder.service [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Creating RPC server for service cinder-volume {{(pid=87726) start /opt/stack/cinder/cinder/service.py:231}} Jul 17 19:36:11 devstack cinder-volume[87726]: DEBUG cinder.service [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87726) start /opt/stack/cinder/cinder/service.py:237}} Jul 17 19:36:12 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 17 19:36:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:36:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:36:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:36:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:36:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:36:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:36:12 devstack sudo[87752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:36:12 devstack sudo[87752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:36:12 devstack sudo[87752]: pam_unix(sudo:session): session closed for user root Jul 17 19:36:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.239s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:36:12 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-4819fd4e-4ce4-4037-9304-77ca37ccaa27 None None] Driver post RPC initialization completed successfully. Jul 17 19:36:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager._thread_info {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:36:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread count: 6 {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 19:36:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread info: [<_MainThread(MainThread, started 130066227544192)>, , , , , ] {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 19:36:20 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:36:21 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:36:22 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=3 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:37:10 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:37:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] Flow 'volume_create_manager' (e5a5754f-9000-4ee8-8f95-531be2fc44a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:37:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642a1f00-4afa-4000-9774-d0da3ee41b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642a1f00-4afa-4000-9774-d0da3ee41b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1893988389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9142ed75-bde6-4625-8b8c-b3cdfa5e5508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0dbf3ebf4b844da800f31f09e30425b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:37:10Z,use_quota=True,user_id='4dd0d92ee6c84cb0be07c222e6c66bb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7425b8bf-3f95-42aa-bbc5-31f46adb19d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7425b8bf-3f95-42aa-bbc5-31f46adb19d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b3cbd8b-804e-4005-91c6-6152c52ee2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b3cbd8b-804e-4005-91c6-6152c52ee2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9142ed75-bde6-4625-8b8c-b3cdfa5e5508', 'volume_name': 'volume-9142ed75-bde6-4625-8b8c-b3cdfa5e5508', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a557c7eb-37ff-454d-8cdb-cbefe41fe4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a557c7eb-37ff-454d-8cdb-cbefe41fe4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13527311-8d21-4112-b2a6-9a8014cca5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:10 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] Volume 9142ed75-bde6-4625-8b8c-b3cdfa5e5508: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9142ed75-bde6-4625-8b8c-b3cdfa5e5508', 'volume_size': 1} Jul 17 19:37:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:37:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:37:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1893988389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9142ed75-bde6-4625-8b8c-b3cdfa5e5508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0dbf3ebf4b844da800f31f09e30425b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:37:10Z,use_quota=True,user_id='4dd0d92ee6c84cb0be07c222e6c66bb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:37:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] Creating volume 9142ed75-bde6-4625-8b8c-b3cdfa5e5508 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:37:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:37:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:37:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:37:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:37:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:37:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:37:10 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:37:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9142ed75-bde6-4625-8b8c-b3cdfa5e5508 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:10 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9142ed75-bde6-4625-8b8c-b3cdfa5e5508 1073741824 Jul 17 19:37:10 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:10 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:37:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] Flow 'volume_create_manager' (7b62908a-c8c9-427d-bb59-8223d31de989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:37:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ea6e98-172e-410a-9a12-3ef6416644e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ea6e98-172e-410a-9a12-3ef6416644e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-919117634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7504e8bd-a6a6-4194-8efd-09042cfd3be9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b100ad54205d4908bed5881602c5db3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:37:11Z,use_quota=True,user_id='ac0e22e2e382461e8689bff375d182c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4083dde-9436-430f-ac4c-2e04aab3451a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4083dde-9436-430f-ac4c-2e04aab3451a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e571954f-957a-4247-b12e-1eb103b3a8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e571954f-957a-4247-b12e-1eb103b3a8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7504e8bd-a6a6-4194-8efd-09042cfd3be9', 'volume_name': 'volume-7504e8bd-a6a6-4194-8efd-09042cfd3be9', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42aa21ca-ef7f-4394-bdc9-6ebbe51a68d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42aa21ca-ef7f-4394-bdc9-6ebbe51a68d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3689c258-3f7f-4124-ad0c-916485477134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:11 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] Volume 7504e8bd-a6a6-4194-8efd-09042cfd3be9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7504e8bd-a6a6-4194-8efd-09042cfd3be9', 'volume_size': 1} Jul 17 19:37:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:37:11 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9142ed75-bde6-4625-8b8c-b3cdfa5e5508 1073741824" returned: 0 in 0.735s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9142ed75-bde6-4625-8b8c-b3cdfa5e5508 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:11 devstack sudo[88614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9142ed75-bde6-4625-8b8c-b3cdfa5e5508 Jul 17 19:37:11 devstack sudo[88614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:11 devstack sudo[88614]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9142ed75-bde6-4625-8b8c-b3cdfa5e5508" returned: 0 in 0.371s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:37:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:37:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.558s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:37:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-919117634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7504e8bd-a6a6-4194-8efd-09042cfd3be9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b100ad54205d4908bed5881602c5db3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:37:11Z,use_quota=True,user_id='ac0e22e2e382461e8689bff375d182c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:37:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] Creating volume 7504e8bd-a6a6-4194-8efd-09042cfd3be9 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:37:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:37:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:37:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:37:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:37:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:37:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:37:11 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:37:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7504e8bd-a6a6-4194-8efd-09042cfd3be9 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13527311-8d21-4112-b2a6-9a8014cca5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9142ed75-bde6-4625-8b8c-b3cdfa5e5508', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:11 devstack sudo[88645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7504e8bd-a6a6-4194-8efd-09042cfd3be9 1073741824 Jul 17 19:37:11 devstack sudo[88645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e1ebc23-3592-4b02-8755-612a418541e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:11 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] Volume volume-9142ed75-bde6-4625-8b8c-b3cdfa5e5508 (9142ed75-bde6-4625-8b8c-b3cdfa5e5508): created successfully Jul 17 19:37:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e1ebc23-3592-4b02-8755-612a418541e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] Flow 'volume_create_manager' (e5a5754f-9000-4ee8-8f95-531be2fc44a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:37:11 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-8c08dd00-7e77-4c23-b176-cb5ae29406e0 tempest-DeleteServersTestJSON-620631611 None] Created volume successfully. Jul 17 19:37:12 devstack sudo[88645]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7504e8bd-a6a6-4194-8efd-09042cfd3be9 1073741824" returned: 0 in 0.611s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7504e8bd-a6a6-4194-8efd-09042cfd3be9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:12 devstack sudo[88657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7504e8bd-a6a6-4194-8efd-09042cfd3be9 Jul 17 19:37:12 devstack sudo[88657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:12 devstack sudo[88657]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7504e8bd-a6a6-4194-8efd-09042cfd3be9" returned: 0 in 0.287s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:37:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:37:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3689c258-3f7f-4124-ad0c-916485477134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7504e8bd-a6a6-4194-8efd-09042cfd3be9', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80fe0af-7f69-4c78-97f7-870940bfcd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:12 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] Volume volume-7504e8bd-a6a6-4194-8efd-09042cfd3be9 (7504e8bd-a6a6-4194-8efd-09042cfd3be9): created successfully Jul 17 19:37:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80fe0af-7f69-4c78-97f7-870940bfcd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] Flow 'volume_create_manager' (7b62908a-c8c9-427d-bb59-8223d31de989) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:37:12 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-0658acd1-b2a1-4556-ae01-b1e7fa47be48 req-d2287aa6-8e9a-4ac3-b685-773ee935f6c4 tempest-VolumesGetTestJSON-1639256195 None] Created volume successfully. Jul 17 19:37:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [req-a6273fc0-6062-472e-b1f8-9354eb2342cc req-76883089-e95a-45bb-8c6e-d348ecb94b45 tempest-VolumesGetTestJSON-1639256195 None] Acquiring lock "cinder-7504e8bd-a6a6-4194-8efd-09042cfd3be9-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:37:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [req-a6273fc0-6062-472e-b1f8-9354eb2342cc req-76883089-e95a-45bb-8c6e-d348ecb94b45 tempest-VolumesGetTestJSON-1639256195 None] Lock "cinder-7504e8bd-a6a6-4194-8efd-09042cfd3be9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:37:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [req-a6273fc0-6062-472e-b1f8-9354eb2342cc req-76883089-e95a-45bb-8c6e-d348ecb94b45 tempest-VolumesGetTestJSON-1639256195 None] Acquiring lock "cinder-quobyte-7504e8bd-a6a6-4194-8efd-09042cfd3be9" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:37:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [req-a6273fc0-6062-472e-b1f8-9354eb2342cc req-76883089-e95a-45bb-8c6e-d348ecb94b45 tempest-VolumesGetTestJSON-1639256195 None] Lock "cinder-quobyte-7504e8bd-a6a6-4194-8efd-09042cfd3be9" acquired by "delete_volume" :: waited 0.021s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:37:13 devstack cinder-volume[87726]: INFO oslo.privsep.daemon [req-a6273fc0-6062-472e-b1f8-9354eb2342cc req-76883089-e95a-45bb-8c6e-d348ecb94b45 tempest-VolumesGetTestJSON-1639256195 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpuvudacis/privsep.sock'] Jul 17 19:37:13 devstack sudo[88666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpuvudacis/privsep.sock Jul 17 19:37:13 devstack sudo[88666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:14 devstack cinder-volume[87726]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 17 19:37:14 devstack cinder-volume[87726]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 17 19:37:14 devstack cinder-volume[87726]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 17 19:37:14 devstack cinder-volume[87726]: WARNING oslo.privsep.daemon [-] privsep log: Jul 17 19:37:14 devstack cinder-volume[87726]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 17 19:37:14 devstack cinder-volume[87726]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 17 19:37:14 devstack cinder-volume[87726]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 17 19:37:14 devstack cinder-volume[87726]: WARNING oslo.privsep.daemon [-] privsep log: Jul 17 19:37:14 devstack cinder-volume[87726]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 17 19:37:14 devstack sudo[88666]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:14 devstack cinder-volume[87726]: INFO oslo.privsep.daemon [req-a6273fc0-6062-472e-b1f8-9354eb2342cc req-76883089-e95a-45bb-8c6e-d348ecb94b45 tempest-VolumesGetTestJSON-1639256195 None] Spawned new privsep daemon via rootwrap Jul 17 19:37:14 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [req-a6273fc0-6062-472e-b1f8-9354eb2342cc req-76883089-e95a-45bb-8c6e-d348ecb94b45 tempest-VolumesGetTestJSON-1639256195 None] Accepted privsep connection to /tmp/tmpuvudacis/privsep.sock {{(pid=87726) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 17 19:37:14 devstack cinder-volume[87726]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 17 19:37:14 devstack cinder-volume[87726]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 17 19:37:14 devstack cinder-volume[87726]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 17 19:37:14 devstack cinder-volume[87726]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88674 Jul 17 19:37:14 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[860dc84c-ef66-495c-86a1-102bbe597e6a]: (2,) {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:37:14 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd4b779-fc77-4165-a457-67f6b8d60846]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:37:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-a6273fc0-6062-472e-b1f8-9354eb2342cc req-76883089-e95a-45bb-8c6e-d348ecb94b45 tempest-VolumesGetTestJSON-1639256195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7504e8bd-a6a6-4194-8efd-09042cfd3be9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:14 devstack cinder-volume[87726]: WARNING py.warnings [req-5d6e4b14-112e-4c33-ab92-ea3b3d2c4479 req-fda510d7-2b2a-44d0-9199-6f2a797f5c96 tempest-DeleteServersTestJSON-620631611 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 17 19:37:14 devstack cinder-volume[87726]: .first() Jul 17 19:37:14 devstack cinder-volume[87726]: Jul 17 19:37:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-5d6e4b14-112e-4c33-ab92-ea3b3d2c4479 req-fda510d7-2b2a-44d0-9199-6f2a797f5c96 tempest-DeleteServersTestJSON-620631611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:37:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-5d6e4b14-112e-4c33-ab92-ea3b3d2c4479 req-fda510d7-2b2a-44d0-9199-6f2a797f5c96 tempest-DeleteServersTestJSON-620631611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:37:14 devstack sudo[88684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7504e8bd-a6a6-4194-8efd-09042cfd3be9 Jul 17 19:37:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-5d6e4b14-112e-4c33-ab92-ea3b3d2c4479 req-fda510d7-2b2a-44d0-9199-6f2a797f5c96 tempest-DeleteServersTestJSON-620631611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:37:14 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-5d6e4b14-112e-4c33-ab92-ea3b3d2c4479 req-fda510d7-2b2a-44d0-9199-6f2a797f5c96 tempest-DeleteServersTestJSON-620631611 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55', 'name': 'volume-9142ed75-bde6-4625-8b8c-b3cdfa5e5508', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7af7d9a0-8f2e-43f1-9c0c-4360c95aa1f9', 'enforce_multipath': True} {{(pid=87726) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 19:37:15 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-5d6e4b14-112e-4c33-ab92-ea3b3d2c4479 req-fda510d7-2b2a-44d0-9199-6f2a797f5c96 tempest-DeleteServersTestJSON-620631611 None] attachment_update completed successfully. Jul 17 19:37:15 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-a6273fc0-6062-472e-b1f8-9354eb2342cc req-76883089-e95a-45bb-8c6e-d348ecb94b45 tempest-VolumesGetTestJSON-1639256195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7504e8bd-a6a6-4194-8efd-09042cfd3be9" returned: 0 in 0.430s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-a6273fc0-6062-472e-b1f8-9354eb2342cc req-76883089-e95a-45bb-8c6e-d348ecb94b45 tempest-VolumesGetTestJSON-1639256195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7504e8bd-a6a6-4194-8efd-09042cfd3be9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:15 devstack sudo[88691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7504e8bd-a6a6-4194-8efd-09042cfd3be9 Jul 17 19:37:15 devstack sudo[88691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:37:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:37:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:37:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:37:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:37:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:37:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:15 devstack sudo[88693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:37:15 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:15 devstack sudo[88691]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-a6273fc0-6062-472e-b1f8-9354eb2342cc req-76883089-e95a-45bb-8c6e-d348ecb94b45 tempest-VolumesGetTestJSON-1639256195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7504e8bd-a6a6-4194-8efd-09042cfd3be9" returned: 0 in 0.307s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:15 devstack cinder-volume[87726]: DEBUG cinder.coordination [req-a6273fc0-6062-472e-b1f8-9354eb2342cc req-76883089-e95a-45bb-8c6e-d348ecb94b45 tempest-VolumesGetTestJSON-1639256195 None] Lock "cinder-quobyte-7504e8bd-a6a6-4194-8efd-09042cfd3be9" released by "delete_volume" :: held 2.078s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:37:15 devstack cinder-volume[87726]: WARNING cinder.quota [req-a6273fc0-6062-472e-b1f8-9354eb2342cc req-76883089-e95a-45bb-8c6e-d348ecb94b45 tempest-VolumesGetTestJSON-1639256195 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:37:15 devstack cinder-volume[87726]: WARNING cinder.quota [req-a6273fc0-6062-472e-b1f8-9354eb2342cc req-76883089-e95a-45bb-8c6e-d348ecb94b45 tempest-VolumesGetTestJSON-1639256195 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:37:15 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.395s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:15 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:37:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager._thread_info {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:37:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread count: 8 {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 19:37:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread info: [<_MainThread(MainThread, started 130066227544192)>, , , , , , , ] {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 19:37:15 devstack cinder-volume[87726]: DEBUG cinder.quota [req-a6273fc0-6062-472e-b1f8-9354eb2342cc req-76883089-e95a-45bb-8c6e-d348ecb94b45 tempest-VolumesGetTestJSON-1639256195 None] Created reservations ['f9b0b08a-dd93-4f15-93c5-07eabaf4a8d4', '2bf67152-7856-4dd0-9403-ca629f7b1b5b', '5e8695a7-e336-4370-b451-e18d374ad5bf', '082e9ed0-a794-4ea0-9c14-e3c0af4650e2'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:37:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-a6273fc0-6062-472e-b1f8-9354eb2342cc req-76883089-e95a-45bb-8c6e-d348ecb94b45 tempest-VolumesGetTestJSON-1639256195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:37:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-a6273fc0-6062-472e-b1f8-9354eb2342cc req-76883089-e95a-45bb-8c6e-d348ecb94b45 tempest-VolumesGetTestJSON-1639256195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:37:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [req-a6273fc0-6062-472e-b1f8-9354eb2342cc req-76883089-e95a-45bb-8c6e-d348ecb94b45 tempest-VolumesGetTestJSON-1639256195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:37:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [req-a6273fc0-6062-472e-b1f8-9354eb2342cc req-76883089-e95a-45bb-8c6e-d348ecb94b45 tempest-VolumesGetTestJSON-1639256195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:37:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-a6273fc0-6062-472e-b1f8-9354eb2342cc req-76883089-e95a-45bb-8c6e-d348ecb94b45 tempest-VolumesGetTestJSON-1639256195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:37:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-a6273fc0-6062-472e-b1f8-9354eb2342cc req-76883089-e95a-45bb-8c6e-d348ecb94b45 tempest-VolumesGetTestJSON-1639256195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:15 devstack sudo[88765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:37:15 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:16 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-a6273fc0-6062-472e-b1f8-9354eb2342cc req-76883089-e95a-45bb-8c6e-d348ecb94b45 tempest-VolumesGetTestJSON-1639256195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.367s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:16 devstack cinder-volume[87726]: DEBUG cinder.manager [req-a6273fc0-6062-472e-b1f8-9354eb2342cc req-76883089-e95a-45bb-8c6e-d348ecb94b45 tempest-VolumesGetTestJSON-1639256195 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:37:16 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-a6273fc0-6062-472e-b1f8-9354eb2342cc req-76883089-e95a-45bb-8c6e-d348ecb94b45 tempest-VolumesGetTestJSON-1639256195 None] Deleted volume successfully. Jul 17 19:37:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [req-a6273fc0-6062-472e-b1f8-9354eb2342cc req-76883089-e95a-45bb-8c6e-d348ecb94b45 tempest-VolumesGetTestJSON-1639256195 None] Lock "cinder-7504e8bd-a6a6-4194-8efd-09042cfd3be9-delete_volume" released by "delete_volume" :: held 2.840s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:37:20 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-4b3eea09-69e3-44e8-8371-f0ac1b661b32 req-4fc68ceb-d319-44aa-9fe2-d574d6286d91 tempest-DeleteServersTestJSON-620631611 None] Terminate volume connection completed successfully. Jul 17 19:37:20 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-4b3eea09-69e3-44e8-8371-f0ac1b661b32 req-4fc68ceb-d319-44aa-9fe2-d574d6286d91 tempest-DeleteServersTestJSON-620631611 None] Deleting attachment 7af7d9a0-8f2e-43f1-9c0c-4360c95aa1f9. {{(pid=87726) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 19:37:22 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:37:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] Flow 'volume_create_manager' (0c188cac-0faa-4728-a9b2-b102755d6a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:37:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf701c0e-69b3-406d-bb43-17447762a712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf701c0e-69b3-406d-bb43-17447762a712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-205295191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5237f408-9530-4077-ada7-4cc2eda94a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde962f2c5b14fd984133bead4364eae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:37:22Z,use_quota=True,user_id='76bdd78850d744df8ad2ade49dacc733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0265605-de04-440f-aa5d-37c5bc155772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0265605-de04-440f-aa5d-37c5bc155772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e760ec8b-d69a-4170-bdea-2e313b8ac1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e760ec8b-d69a-4170-bdea-2e313b8ac1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5237f408-9530-4077-ada7-4cc2eda94a2f', 'volume_name': 'volume-5237f408-9530-4077-ada7-4cc2eda94a2f', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (980ede86-e680-442d-8976-d5ae21fa82fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (980ede86-e680-442d-8976-d5ae21fa82fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e7af01b-b8ee-4b13-98eb-7d06b783196c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:22 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] Volume 5237f408-9530-4077-ada7-4cc2eda94a2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5237f408-9530-4077-ada7-4cc2eda94a2f', 'volume_size': 1} Jul 17 19:37:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:37:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:37:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-205295191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5237f408-9530-4077-ada7-4cc2eda94a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde962f2c5b14fd984133bead4364eae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:37:22Z,use_quota=True,user_id='76bdd78850d744df8ad2ade49dacc733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:37:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] Creating volume 5237f408-9530-4077-ada7-4cc2eda94a2f {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:37:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:37:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:37:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:37:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:37:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:37:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:37:22 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:37:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5237f408-9530-4077-ada7-4cc2eda94a2f 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:22 devstack sudo[89151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5237f408-9530-4077-ada7-4cc2eda94a2f 1073741824 Jul 17 19:37:22 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6ca9d794-90e7-439e-bc1a-d629ebbc9155 tempest-DeleteServersTestJSON-620631611 None] Acquiring lock "cinder-9142ed75-bde6-4625-8b8c-b3cdfa5e5508-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:37:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6ca9d794-90e7-439e-bc1a-d629ebbc9155 tempest-DeleteServersTestJSON-620631611 None] Lock "cinder-9142ed75-bde6-4625-8b8c-b3cdfa5e5508-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:37:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6ca9d794-90e7-439e-bc1a-d629ebbc9155 tempest-DeleteServersTestJSON-620631611 None] Acquiring lock "cinder-quobyte-9142ed75-bde6-4625-8b8c-b3cdfa5e5508" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:37:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6ca9d794-90e7-439e-bc1a-d629ebbc9155 tempest-DeleteServersTestJSON-620631611 None] Lock "cinder-quobyte-9142ed75-bde6-4625-8b8c-b3cdfa5e5508" acquired by "delete_volume" :: waited 0.028s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:37:22 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[96defdc8-fd81-402d-9290-9fb67c21282f]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:37:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6ca9d794-90e7-439e-bc1a-d629ebbc9155 tempest-DeleteServersTestJSON-620631611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9142ed75-bde6-4625-8b8c-b3cdfa5e5508 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:22 devstack sudo[89153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9142ed75-bde6-4625-8b8c-b3cdfa5e5508 Jul 17 19:37:22 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:23 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5237f408-9530-4077-ada7-4cc2eda94a2f 1073741824" returned: 0 in 0.796s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:23 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:23 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-8d9686e8-8eea-4be6-95d0-15398a7a9e00 tempest-GroupSnapshotsTest-218644072 None] Group tempest-GroupSnapshotsTest-Group-938274752: creating Jul 17 19:37:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6ca9d794-90e7-439e-bc1a-d629ebbc9155 tempest-DeleteServersTestJSON-620631611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9142ed75-bde6-4625-8b8c-b3cdfa5e5508" returned: 0 in 0.623s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6ca9d794-90e7-439e-bc1a-d629ebbc9155 tempest-DeleteServersTestJSON-620631611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9142ed75-bde6-4625-8b8c-b3cdfa5e5508 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:23 devstack sudo[89163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9142ed75-bde6-4625-8b8c-b3cdfa5e5508 Jul 17 19:37:23 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:23 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-8d9686e8-8eea-4be6-95d0-15398a7a9e00 tempest-GroupSnapshotsTest-218644072 None] Group tempest-GroupSnapshotsTest-Group-938274752: created successfully Jul 17 19:37:23 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-8d9686e8-8eea-4be6-95d0-15398a7a9e00 tempest-GroupSnapshotsTest-218644072 None] Create group completed successfully. Jul 17 19:37:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5237f408-9530-4077-ada7-4cc2eda94a2f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:23 devstack sudo[89165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5237f408-9530-4077-ada7-4cc2eda94a2f Jul 17 19:37:23 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:23 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6ca9d794-90e7-439e-bc1a-d629ebbc9155 tempest-DeleteServersTestJSON-620631611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9142ed75-bde6-4625-8b8c-b3cdfa5e5508" returned: 0 in 0.324s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6ca9d794-90e7-439e-bc1a-d629ebbc9155 tempest-DeleteServersTestJSON-620631611 None] Lock "cinder-quobyte-9142ed75-bde6-4625-8b8c-b3cdfa5e5508" released by "delete_volume" :: held 1.018s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:37:23 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5237f408-9530-4077-ada7-4cc2eda94a2f" returned: 0 in 0.330s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:37:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:37:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e7af01b-b8ee-4b13-98eb-7d06b783196c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5237f408-9530-4077-ada7-4cc2eda94a2f', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d43b44-8578-4d2a-9dfa-8541968f51dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:23 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-6ca9d794-90e7-439e-bc1a-d629ebbc9155 tempest-DeleteServersTestJSON-620631611 None] Created reservations ['5436f2c5-bbea-4ded-912c-02613b374051', '6b4861e5-7e4e-42d1-acc6-bd676cef11d8', '6f400f0e-2173-4431-8209-ee667a56d666', '334209cd-fe8c-47ef-865f-3806a0c9399d'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:37:23 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] Volume volume-5237f408-9530-4077-ada7-4cc2eda94a2f (5237f408-9530-4077-ada7-4cc2eda94a2f): created successfully Jul 17 19:37:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d43b44-8578-4d2a-9dfa-8541968f51dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] Flow 'volume_create_manager' (0c188cac-0faa-4728-a9b2-b102755d6a26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:37:23 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-eac48ffc-df4d-4360-976e-dfee51ab6601 tempest-ServerActionsTestOtherA-2088443176 None] Created volume successfully. Jul 17 19:37:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6ca9d794-90e7-439e-bc1a-d629ebbc9155 tempest-DeleteServersTestJSON-620631611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:37:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6ca9d794-90e7-439e-bc1a-d629ebbc9155 tempest-DeleteServersTestJSON-620631611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:37:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6ca9d794-90e7-439e-bc1a-d629ebbc9155 tempest-DeleteServersTestJSON-620631611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:37:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6ca9d794-90e7-439e-bc1a-d629ebbc9155 tempest-DeleteServersTestJSON-620631611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:37:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6ca9d794-90e7-439e-bc1a-d629ebbc9155 tempest-DeleteServersTestJSON-620631611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:37:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6ca9d794-90e7-439e-bc1a-d629ebbc9155 tempest-DeleteServersTestJSON-620631611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:23 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:37:23 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:24 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6ca9d794-90e7-439e-bc1a-d629ebbc9155 tempest-DeleteServersTestJSON-620631611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.263s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:24 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-6ca9d794-90e7-439e-bc1a-d629ebbc9155 tempest-DeleteServersTestJSON-620631611 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:37:24 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-6ca9d794-90e7-439e-bc1a-d629ebbc9155 tempest-DeleteServersTestJSON-620631611 None] Deleted volume successfully. Jul 17 19:37:24 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6ca9d794-90e7-439e-bc1a-d629ebbc9155 tempest-DeleteServersTestJSON-620631611 None] Lock "cinder-9142ed75-bde6-4625-8b8c-b3cdfa5e5508-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:37:25 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:37:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] Flow 'volume_create_manager' (fc993ba7-e5b5-42d3-ac22-d6b500fe84a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:37:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4601cb-aaa1-4c43-aa79-cbf6c622e000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4601cb-aaa1-4c43-aa79-cbf6c622e000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-127030417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0fe2eca6-8672-4499-90c9-73171f5ed0ef,host='devstack@QuobyteHD#QuobyteHD',id=6eac4754-b119-4f36-a31d-bcc255f7727d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95c964b3968d4c4bb6ca9fc77677ddeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:37:25Z,use_quota=True,user_id='41b66c5b70d844f68cdc843bf3754d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34774c41-8284-4130-8026-5b8101ae1b51),volume_type_id=34774c41-8284-4130-8026-5b8101ae1b51)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15817efc-d96f-4bdc-9d42-66da8f25321b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15817efc-d96f-4bdc-9d42-66da8f25321b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d02aefa-f7d9-43ef-a2e5-08e65cb89faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d02aefa-f7d9-43ef-a2e5-08e65cb89faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eac4754-b119-4f36-a31d-bcc255f7727d', 'volume_name': 'volume-6eac4754-b119-4f36-a31d-bcc255f7727d', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a2008fb-0cc0-4603-b3d4-0f5e16da90b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a2008fb-0cc0-4603-b3d4-0f5e16da90b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbcdb51f-0f3a-4277-9763-1d1a4992c4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:25 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] Volume 6eac4754-b119-4f36-a31d-bcc255f7727d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eac4754-b119-4f36-a31d-bcc255f7727d', 'volume_size': 1} Jul 17 19:37:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:37:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:37:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0fe2eca6-8672-4499-90c9-73171f5ed0ef,created_at=2026-07-17T17:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-127030417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0fe2eca6-8672-4499-90c9-73171f5ed0ef,host='devstack@QuobyteHD#QuobyteHD',id=6eac4754-b119-4f36-a31d-bcc255f7727d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95c964b3968d4c4bb6ca9fc77677ddeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:37:25Z,use_quota=True,user_id='41b66c5b70d844f68cdc843bf3754d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34774c41-8284-4130-8026-5b8101ae1b51),volume_type_id=34774c41-8284-4130-8026-5b8101ae1b51)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:37:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] Creating volume 6eac4754-b119-4f36-a31d-bcc255f7727d {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:37:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:37:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:37:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:37:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:37:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:37:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:37:25 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:37:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:25 devstack sudo[89172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d 1073741824 Jul 17 19:37:25 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:25 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d 1073741824" returned: 0 in 0.450s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:25 devstack sudo[89178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d Jul 17 19:37:25 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:25 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d" returned: 0 in 0.300s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:37:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:37:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbcdb51f-0f3a-4277-9763-1d1a4992c4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eac4754-b119-4f36-a31d-bcc255f7727d', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f6f97d-9fa8-4da2-b835-ef45890ed9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:26 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] Volume volume-6eac4754-b119-4f36-a31d-bcc255f7727d (6eac4754-b119-4f36-a31d-bcc255f7727d): created successfully Jul 17 19:37:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f6f97d-9fa8-4da2-b835-ef45890ed9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] Flow 'volume_create_manager' (fc993ba7-e5b5-42d3-ac22-d6b500fe84a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:37:26 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-62dc6d85-0c0b-47fb-bf57-ada4f3835403 tempest-GroupSnapshotsTest-218644072 None] Created volume successfully. Jul 17 19:37:26 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-3aca0553-6947-4a1c-98a1-ab0291a29ede tempest-GroupSnapshotsTest-218644072 None] GroupSnapshot 1d830dc0-83ee-484d-aa3e-4712eb524fa8: creating. Jul 17 19:37:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3aca0553-6947-4a1c-98a1-ab0291a29ede tempest-GroupSnapshotsTest-218644072 None] Group snapshot 1d830dc0-83ee-484d-aa3e-4712eb524fa8: creating. {{(pid=87726) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 17 19:37:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-3aca0553-6947-4a1c-98a1-ab0291a29ede tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:37:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-3aca0553-6947-4a1c-98a1-ab0291a29ede tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:37:26 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-3aca0553-6947-4a1c-98a1-ab0291a29ede tempest-GroupSnapshotsTest-218644072 None] Creating offline snapshot 43b58436-6dde-48eb-833e-6e3fc3ce9b15 of volume 6eac4754-b119-4f36-a31d-bcc255f7727d {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:37:26 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0872c96-13d4-4df7-9a62-c8361906382e]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:37:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-3aca0553-6947-4a1c-98a1-ab0291a29ede tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:27 devstack sudo[89186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d Jul 17 19:37:27 devstack sudo[89186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:27 devstack sudo[89186]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-3aca0553-6947-4a1c-98a1-ab0291a29ede tempest-GroupSnapshotsTest-218644072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d" returned: 0 in 0.433s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-3aca0553-6947-4a1c-98a1-ab0291a29ede tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d.43b58436-6dde-48eb-833e-6e3fc3ce9b15 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:27 devstack sudo[89196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d.43b58436-6dde-48eb-833e-6e3fc3ce9b15 1G Jul 17 19:37:27 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:27 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-3aca0553-6947-4a1c-98a1-ab0291a29ede tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d.43b58436-6dde-48eb-833e-6e3fc3ce9b15 1G" returned: 0 in 0.533s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-3aca0553-6947-4a1c-98a1-ab0291a29ede tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eac4754-b119-4f36-a31d-bcc255f7727d -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d.43b58436-6dde-48eb-833e-6e3fc3ce9b15 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:28 devstack sudo[89203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eac4754-b119-4f36-a31d-bcc255f7727d -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d.43b58436-6dde-48eb-833e-6e3fc3ce9b15 Jul 17 19:37:28 devstack sudo[89203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:28 devstack sudo[89203]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-3aca0553-6947-4a1c-98a1-ab0291a29ede tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eac4754-b119-4f36-a31d-bcc255f7727d -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d.43b58436-6dde-48eb-833e-6e3fc3ce9b15" returned: 0 in 0.419s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:28 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-3aca0553-6947-4a1c-98a1-ab0291a29ede tempest-GroupSnapshotsTest-218644072 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d.43b58436-6dde-48eb-833e-6e3fc3ce9b15 is being set with open permissions: ugo+rw: NotImplementedError Jul 17 19:37:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-3aca0553-6947-4a1c-98a1-ab0291a29ede tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d.43b58436-6dde-48eb-833e-6e3fc3ce9b15 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:28 devstack sudo[89212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d.43b58436-6dde-48eb-833e-6e3fc3ce9b15 Jul 17 19:37:28 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:28 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-3aca0553-6947-4a1c-98a1-ab0291a29ede tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d.43b58436-6dde-48eb-833e-6e3fc3ce9b15" returned: 0 in 0.326s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-3aca0553-6947-4a1c-98a1-ab0291a29ede tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:28 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d.info Jul 17 19:37:28 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:29 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-3aca0553-6947-4a1c-98a1-ab0291a29ede tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d.info" returned: 0 in 0.358s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:29 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-3aca0553-6947-4a1c-98a1-ab0291a29ede tempest-GroupSnapshotsTest-218644072 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d.info is being set with open permissions: ugo+rw: NotImplementedError Jul 17 19:37:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-3aca0553-6947-4a1c-98a1-ab0291a29ede tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:29 devstack sudo[89234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d.info Jul 17 19:37:29 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:29 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-3aca0553-6947-4a1c-98a1-ab0291a29ede tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d.info" returned: 0 in 0.271s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-3aca0553-6947-4a1c-98a1-ab0291a29ede tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.488s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:37:29 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-3aca0553-6947-4a1c-98a1-ab0291a29ede tempest-GroupSnapshotsTest-218644072 None] group_snapshot 1d830dc0-83ee-484d-aa3e-4712eb524fa8: created successfully Jul 17 19:37:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:37:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:37:30 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "cinder-quobyte-43b58436-6dde-48eb-833e-6e3fc3ce9b15-a5427692-2720-43c3-b508-a155c4ec844d" by "_create_volume_from_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:37:31 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Lock "cinder-quobyte-43b58436-6dde-48eb-833e-6e3fc3ce9b15-a5427692-2720-43c3-b508-a155c4ec844d" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:37:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Creating volume a5427692-2720-43c3-b508-a155c4ec844d from snapshot 43b58436-6dde-48eb-833e-6e3fc3ce9b15 {{(pid=87726) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 19:37:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:37:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:37:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:37:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:37:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:37:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:37:31 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "cinder-quobyte-a5427692-2720-43c3-b508-a155c4ec844d" by "_copy_volume_from_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:37:31 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Lock "cinder-quobyte-a5427692-2720-43c3-b508-a155c4ec844d" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:37:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] snapshot: 43b58436-6dde-48eb-833e-6e3fc3ce9b15, volume: a5427692-2720-43c3-b508-a155c4ec844d, {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 19:37:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:37:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:37:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:37:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:37:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:37:31 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc0d7f2-c0cc-40da-bdd9-fb8f9a0cf3c7]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:37:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d.43b58436-6dde-48eb-833e-6e3fc3ce9b15 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:31 devstack sudo[89238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d.43b58436-6dde-48eb-833e-6e3fc3ce9b15 Jul 17 19:37:31 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:31 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d.43b58436-6dde-48eb-833e-6e3fc3ce9b15" returned: 0 in 0.404s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6eac4754-b119-4f36-a31d-bcc255f7727d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:37:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 19:37:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Creating direct copy from snapshot {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 19:37:31 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f77c42-1d2c-40f2-8d00-054d450153fb]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:37:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:31 devstack sudo[89244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d Jul 17 19:37:31 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:31 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d" returned: 0 in 0.449s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:32 devstack cinder-volume[87726]: DEBUG cinder.utils [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Path /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a5427692-2720-43c3-b508-a155c4ec844d not found in is_blk_device check {{(pid=87726) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 19:37:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a5427692-2720-43c3-b508-a155c4ec844d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:32 devstack sudo[89251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a5427692-2720-43c3-b508-a155c4ec844d Jul 17 19:37:32 devstack sudo[89251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:39 devstack sudo[89251]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a5427692-2720-43c3-b508-a155c4ec844d" returned: 0 in 7.477s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:39 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[5807b1ea-3db3-4ee0-8f4a-1f696ff8405a]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:37:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:39 devstack sudo[89360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d Jul 17 19:37:39 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:40 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d" returned: 0 in 0.851s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:40 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Image conversion details: src /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d, size 1024.00 MB, duration 7.48 sec, destination /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a5427692-2720-43c3-b508-a155c4ec844d {{(pid=87726) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 19:37:40 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Converted 1024.00 MB image at 136.94 MB/s Jul 17 19:37:40 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a5427692-2720-43c3-b508-a155c4ec844d is being set with open permissions: ugo+rw: NotImplementedError Jul 17 19:37:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a5427692-2720-43c3-b508-a155c4ec844d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:40 devstack sudo[89371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a5427692-2720-43c3-b508-a155c4ec844d Jul 17 19:37:40 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:40 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a5427692-2720-43c3-b508-a155c4ec844d" returned: 0 in 0.389s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:40 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Lock "cinder-quobyte-a5427692-2720-43c3-b508-a155c4ec844d" released by "_copy_volume_from_snapshot" :: held 9.739s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:37:40 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Lock "cinder-quobyte-43b58436-6dde-48eb-833e-6e3fc3ce9b15-a5427692-2720-43c3-b508-a155c4ec844d" released by "_create_volume_from_snapshot" :: held 9.784s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:37:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.804s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:37:40 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-cb94a10c-48d6-40b4-957f-3b7d37960d42 tempest-GroupSnapshotsTest-218644072 None] Create group from source-snapshot-1d830dc0-83ee-484d-aa3e-4712eb524fa8 completed successfully. Jul 17 19:37:42 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-43a384fd-1067-43a3-8793-6744acd1af7d tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "cinder-quobyte-a5427692-2720-43c3-b508-a155c4ec844d" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:37:42 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-43a384fd-1067-43a3-8793-6744acd1af7d tempest-GroupSnapshotsTest-218644072 None] Lock "cinder-quobyte-a5427692-2720-43c3-b508-a155c4ec844d" acquired by "delete_volume" :: waited 0.040s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:37:42 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[96594ce4-fc11-4bb7-9731-e9a00a299633]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:37:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-43a384fd-1067-43a3-8793-6744acd1af7d tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a5427692-2720-43c3-b508-a155c4ec844d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:42 devstack sudo[89374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a5427692-2720-43c3-b508-a155c4ec844d Jul 17 19:37:42 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:43 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-43a384fd-1067-43a3-8793-6744acd1af7d tempest-GroupSnapshotsTest-218644072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a5427692-2720-43c3-b508-a155c4ec844d" returned: 0 in 0.514s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-43a384fd-1067-43a3-8793-6744acd1af7d tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a5427692-2720-43c3-b508-a155c4ec844d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:43 devstack sudo[89379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a5427692-2720-43c3-b508-a155c4ec844d Jul 17 19:37:43 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:43 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-43a384fd-1067-43a3-8793-6744acd1af7d tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a5427692-2720-43c3-b508-a155c4ec844d" returned: 0 in 0.412s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:43 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-43a384fd-1067-43a3-8793-6744acd1af7d tempest-GroupSnapshotsTest-218644072 None] Lock "cinder-quobyte-a5427692-2720-43c3-b508-a155c4ec844d" released by "delete_volume" :: held 1.039s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:37:43 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-43a384fd-1067-43a3-8793-6744acd1af7d tempest-GroupSnapshotsTest-218644072 None] Created reservations ['b6d4f179-97bd-4895-8eaf-ca7744f98034'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:37:43 devstack cinder-volume[87726]: WARNING cinder.quota [None req-43a384fd-1067-43a3-8793-6744acd1af7d tempest-GroupSnapshotsTest-218644072 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1969123591 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1969123591, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:37:43 devstack cinder-volume[87726]: WARNING cinder.quota [None req-43a384fd-1067-43a3-8793-6744acd1af7d tempest-GroupSnapshotsTest-218644072 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1969123591 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1969123591, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:37:43 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-43a384fd-1067-43a3-8793-6744acd1af7d tempest-GroupSnapshotsTest-218644072 None] Created reservations ['ad1b6af8-120b-4fd1-aabc-d9ae2a6c7184', 'bfea495a-40c1-4bce-ba30-c9a1fa010daa', 'be31ecbc-358e-48b4-9161-e74cdcfef485', '7f9ee3ea-d0be-4a6f-a543-de51b3d97c93'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:37:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-43a384fd-1067-43a3-8793-6744acd1af7d tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:37:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-43a384fd-1067-43a3-8793-6744acd1af7d tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:37:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-43a384fd-1067-43a3-8793-6744acd1af7d tempest-GroupSnapshotsTest-218644072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:37:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-43a384fd-1067-43a3-8793-6744acd1af7d tempest-GroupSnapshotsTest-218644072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:37:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-43a384fd-1067-43a3-8793-6744acd1af7d tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:37:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-43a384fd-1067-43a3-8793-6744acd1af7d tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:44 devstack sudo[89382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:37:44 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:44 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-43a384fd-1067-43a3-8793-6744acd1af7d tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.354s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:44 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-43a384fd-1067-43a3-8793-6744acd1af7d tempest-GroupSnapshotsTest-218644072 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:37:44 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-43a384fd-1067-43a3-8793-6744acd1af7d tempest-GroupSnapshotsTest-218644072 None] Delete group completed successfully. Jul 17 19:37:45 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-0b798978-52ca-40e9-9546-096cc8a56f77 tempest-GroupSnapshotsTest-218644072 None] group_snapshot 1d830dc0-83ee-484d-aa3e-4712eb524fa8: deleting Jul 17 19:37:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0b798978-52ca-40e9-9546-096cc8a56f77 tempest-GroupSnapshotsTest-218644072 None] group_snapshot 1d830dc0-83ee-484d-aa3e-4712eb524fa8: deleting {{(pid=87726) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 17 19:37:45 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0b798978-52ca-40e9-9546-096cc8a56f77 tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "cinder-quobyte-6eac4754-b119-4f36-a31d-bcc255f7727d" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:37:45 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0b798978-52ca-40e9-9546-096cc8a56f77 tempest-GroupSnapshotsTest-218644072 None] Lock "cinder-quobyte-6eac4754-b119-4f36-a31d-bcc255f7727d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:37:45 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0b798978-52ca-40e9-9546-096cc8a56f77 tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "cinder-quobyte-43b58436-6dde-48eb-833e-6e3fc3ce9b15" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:37:45 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0b798978-52ca-40e9-9546-096cc8a56f77 tempest-GroupSnapshotsTest-218644072 None] Lock "cinder-quobyte-43b58436-6dde-48eb-833e-6e3fc3ce9b15" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:37:45 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-0b798978-52ca-40e9-9546-096cc8a56f77 tempest-GroupSnapshotsTest-218644072 None] Deleting offline snapshot 43b58436-6dde-48eb-833e-6e3fc3ce9b15 of volume 6eac4754-b119-4f36-a31d-bcc255f7727d {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:37:45 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-0b798978-52ca-40e9-9546-096cc8a56f77 tempest-GroupSnapshotsTest-218644072 None] snapshot_file for this snap is: volume-6eac4754-b119-4f36-a31d-bcc255f7727d.43b58436-6dde-48eb-833e-6e3fc3ce9b15 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:37:45 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[326dc00d-2eb1-4e02-9de1-d28b9078075d]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:37:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0b798978-52ca-40e9-9546-096cc8a56f77 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d.43b58436-6dde-48eb-833e-6e3fc3ce9b15 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:45 devstack sudo[89385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d.43b58436-6dde-48eb-833e-6e3fc3ce9b15 Jul 17 19:37:45 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:46 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0b798978-52ca-40e9-9546-096cc8a56f77 tempest-GroupSnapshotsTest-218644072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d.43b58436-6dde-48eb-833e-6e3fc3ce9b15" returned: 0 in 0.667s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:46 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-0b798978-52ca-40e9-9546-096cc8a56f77 tempest-GroupSnapshotsTest-218644072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6eac4754-b119-4f36-a31d-bcc255f7727d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:37:46 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[096c4898-ca87-406a-8e5c-e4331b9bc664]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:37:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0b798978-52ca-40e9-9546-096cc8a56f77 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:46 devstack sudo[89390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d Jul 17 19:37:46 devstack sudo[89390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:46 devstack sudo[89390]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0b798978-52ca-40e9-9546-096cc8a56f77 tempest-GroupSnapshotsTest-218644072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d" returned: 0 in 0.581s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0b798978-52ca-40e9-9546-096cc8a56f77 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d.43b58436-6dde-48eb-833e-6e3fc3ce9b15 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:46 devstack sudo[89395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d.43b58436-6dde-48eb-833e-6e3fc3ce9b15 Jul 17 19:37:46 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:47 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0b798978-52ca-40e9-9546-096cc8a56f77 tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d.43b58436-6dde-48eb-833e-6e3fc3ce9b15" returned: 0 in 0.506s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0b798978-52ca-40e9-9546-096cc8a56f77 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d.43b58436-6dde-48eb-833e-6e3fc3ce9b15 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:47 devstack sudo[89401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d.43b58436-6dde-48eb-833e-6e3fc3ce9b15 Jul 17 19:37:47 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:47 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0b798978-52ca-40e9-9546-096cc8a56f77 tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d.43b58436-6dde-48eb-833e-6e3fc3ce9b15" returned: 0 in 0.376s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0b798978-52ca-40e9-9546-096cc8a56f77 tempest-GroupSnapshotsTest-218644072 None] Lock "cinder-quobyte-43b58436-6dde-48eb-833e-6e3fc3ce9b15" released by "_delete_snapshot" :: held 2.266s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:37:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0b798978-52ca-40e9-9546-096cc8a56f77 tempest-GroupSnapshotsTest-218644072 None] Lock "cinder-quobyte-6eac4754-b119-4f36-a31d-bcc255f7727d" released by "delete_snapshot" :: held 2.308s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:37:47 devstack cinder-volume[87726]: WARNING cinder.quota [None req-0b798978-52ca-40e9-9546-096cc8a56f77 tempest-GroupSnapshotsTest-218644072 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1969123591 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1969123591, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:37:47 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-0b798978-52ca-40e9-9546-096cc8a56f77 tempest-GroupSnapshotsTest-218644072 None] Created reservations ['9a77ad60-a365-4b96-8521-e8da0eaeba9e', 'b0fac083-c430-4436-807a-608c8927a4c1', '5169ee9b-5d59-437d-9ef2-d117698dde7d', 'cbbdec73-a4c4-4ad9-aa9d-ca92cc47a5e3'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:37:47 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-0b798978-52ca-40e9-9546-096cc8a56f77 tempest-GroupSnapshotsTest-218644072 None] group_snapshot 1d830dc0-83ee-484d-aa3e-4712eb524fa8: deleted successfully Jul 17 19:37:48 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-288e5125-1d81-451c-a099-7a09020d8d20 tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "cinder-quobyte-6eac4754-b119-4f36-a31d-bcc255f7727d" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:37:48 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-288e5125-1d81-451c-a099-7a09020d8d20 tempest-GroupSnapshotsTest-218644072 None] Lock "cinder-quobyte-6eac4754-b119-4f36-a31d-bcc255f7727d" acquired by "delete_volume" :: waited 0.029s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:37:48 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa88381-15bf-461a-b8e3-3999f2afe601]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:37:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-288e5125-1d81-451c-a099-7a09020d8d20 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:48 devstack sudo[89406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d Jul 17 19:37:48 devstack sudo[89406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:49 devstack sudo[89406]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-288e5125-1d81-451c-a099-7a09020d8d20 tempest-GroupSnapshotsTest-218644072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d" returned: 0 in 0.642s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-288e5125-1d81-451c-a099-7a09020d8d20 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:49 devstack sudo[89436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d Jul 17 19:37:49 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:49 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-288e5125-1d81-451c-a099-7a09020d8d20 tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6eac4754-b119-4f36-a31d-bcc255f7727d" returned: 0 in 0.317s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-288e5125-1d81-451c-a099-7a09020d8d20 tempest-GroupSnapshotsTest-218644072 None] Lock "cinder-quobyte-6eac4754-b119-4f36-a31d-bcc255f7727d" released by "delete_volume" :: held 1.064s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:37:49 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-288e5125-1d81-451c-a099-7a09020d8d20 tempest-GroupSnapshotsTest-218644072 None] Created reservations ['e3654c37-518b-492f-9f22-a104a7e984be'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:37:49 devstack cinder-volume[87726]: WARNING cinder.db.api [None req-288e5125-1d81-451c-a099-7a09020d8d20 tempest-GroupSnapshotsTest-218644072 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1969123591'] Jul 17 19:37:49 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-288e5125-1d81-451c-a099-7a09020d8d20 tempest-GroupSnapshotsTest-218644072 None] Created reservations ['c985b16f-1c5c-452d-9989-1e9512602ead', 'b2ca9645-a372-497c-b38d-29eb05567d73', '4afb8c51-1e74-476a-92d5-c596bb13fb56', '89131eba-3286-417f-bf64-4cf432f161af'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:37:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-288e5125-1d81-451c-a099-7a09020d8d20 tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:37:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-288e5125-1d81-451c-a099-7a09020d8d20 tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:37:49 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-288e5125-1d81-451c-a099-7a09020d8d20 tempest-GroupSnapshotsTest-218644072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:37:49 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-288e5125-1d81-451c-a099-7a09020d8d20 tempest-GroupSnapshotsTest-218644072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:37:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-288e5125-1d81-451c-a099-7a09020d8d20 tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:37:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-288e5125-1d81-451c-a099-7a09020d8d20 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:49 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:37:49 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:50 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-288e5125-1d81-451c-a099-7a09020d8d20 tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.276s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:50 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-288e5125-1d81-451c-a099-7a09020d8d20 tempest-GroupSnapshotsTest-218644072 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:37:50 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-288e5125-1d81-451c-a099-7a09020d8d20 tempest-GroupSnapshotsTest-218644072 None] Delete group completed successfully. Jul 17 19:37:50 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e5699bdb-f0b0-400e-b09e-c2be4a57875b tempest-GroupSnapshotsTest-218644072 None] Group tempest-GroupSnapshotsTest-Group-389943427: creating Jul 17 19:37:50 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e5699bdb-f0b0-400e-b09e-c2be4a57875b tempest-GroupSnapshotsTest-218644072 None] Group tempest-GroupSnapshotsTest-Group-389943427: created successfully Jul 17 19:37:50 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e5699bdb-f0b0-400e-b09e-c2be4a57875b tempest-GroupSnapshotsTest-218644072 None] Create group completed successfully. Jul 17 19:37:52 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:37:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] Flow 'volume_create_manager' (2315b688-73e4-49c6-8ce2-9e3beb116808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:37:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91d4305-3656-4e5e-b9d3-458b11acb519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91d4305-3656-4e5e-b9d3-458b11acb519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1921047225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c64162b1-53fa-4cf0-b17a-114848d0dae9,host='devstack@QuobyteHD#QuobyteHD',id=8d2edfc7-d516-4358-aee2-4d2b1c3c0574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95c964b3968d4c4bb6ca9fc77677ddeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:37:52Z,use_quota=True,user_id='41b66c5b70d844f68cdc843bf3754d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47e3e7e3-f596-4333-a8bb-e2d162c1f266),volume_type_id=47e3e7e3-f596-4333-a8bb-e2d162c1f266)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b27d143-9197-45d1-ba9b-7175e84af9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b27d143-9197-45d1-ba9b-7175e84af9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d567b167-d03f-46a3-8276-bde52c79a5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d567b167-d03f-46a3-8276-bde52c79a5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d2edfc7-d516-4358-aee2-4d2b1c3c0574', 'volume_name': 'volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56004465-6e82-45eb-9be8-67afa8828a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56004465-6e82-45eb-9be8-67afa8828a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fada3ab-16ae-4fc1-b1bb-6ccfa81c03ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:52 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] Volume 8d2edfc7-d516-4358-aee2-4d2b1c3c0574: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574', 'volume_size': 1} Jul 17 19:37:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:37:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:37:52 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c64162b1-53fa-4cf0-b17a-114848d0dae9,created_at=2026-07-17T17:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1921047225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c64162b1-53fa-4cf0-b17a-114848d0dae9,host='devstack@QuobyteHD#QuobyteHD',id=8d2edfc7-d516-4358-aee2-4d2b1c3c0574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95c964b3968d4c4bb6ca9fc77677ddeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:37:52Z,use_quota=True,user_id='41b66c5b70d844f68cdc843bf3754d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47e3e7e3-f596-4333-a8bb-e2d162c1f266),volume_type_id=47e3e7e3-f596-4333-a8bb-e2d162c1f266)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:37:52 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] Creating volume 8d2edfc7-d516-4358-aee2-4d2b1c3c0574 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:37:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:37:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:37:52 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:37:52 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:37:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:37:52 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:37:52 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:37:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:52 devstack sudo[89443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574 1073741824 Jul 17 19:37:52 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:53 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574 1073741824" returned: 0 in 0.579s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:53 devstack sudo[89449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574 Jul 17 19:37:53 devstack sudo[89449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:53 devstack sudo[89449]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574" returned: 0 in 0.275s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:53 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:37:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:37:53 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fada3ab-16ae-4fc1-b1bb-6ccfa81c03ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:53 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1800420e-bbe6-48e7-92b9-0f4637b956bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:53 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] Volume volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574 (8d2edfc7-d516-4358-aee2-4d2b1c3c0574): created successfully Jul 17 19:37:53 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1800420e-bbe6-48e7-92b9-0f4637b956bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:53 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] Flow 'volume_create_manager' (2315b688-73e4-49c6-8ce2-9e3beb116808) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:37:53 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-3a302237-eecf-4f61-8588-8cddd3a36853 tempest-GroupSnapshotsTest-218644072 None] Created volume successfully. Jul 17 19:37:55 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:37:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] Flow 'volume_create_manager' (a9f467ee-d85f-46d5-b709-43a2a8e8bb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:37:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bd5def3-a685-4a77-adcf-520c16644f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bd5def3-a685-4a77-adcf-520c16644f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1232985009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c64162b1-53fa-4cf0-b17a-114848d0dae9,host='devstack@QuobyteHD#QuobyteHD',id=d430ca86-f645-428c-83d7-39f2a469a387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95c964b3968d4c4bb6ca9fc77677ddeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:37:56Z,use_quota=True,user_id='41b66c5b70d844f68cdc843bf3754d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47e3e7e3-f596-4333-a8bb-e2d162c1f266),volume_type_id=47e3e7e3-f596-4333-a8bb-e2d162c1f266)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d42a12c5-00f5-4b9d-8901-0ccd4f4c6a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d42a12c5-00f5-4b9d-8901-0ccd4f4c6a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f2d7bad-d99f-4ae0-b8f7-70598d2a788f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f2d7bad-d99f-4ae0-b8f7-70598d2a788f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd430ca86-f645-428c-83d7-39f2a469a387', 'volume_name': 'volume-d430ca86-f645-428c-83d7-39f2a469a387', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93413cdf-4ff4-41c7-9ecc-4c7a312e8023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93413cdf-4ff4-41c7-9ecc-4c7a312e8023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe848b7-cc2a-404f-843f-f5ecf8f4b2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:55 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] Volume d430ca86-f645-428c-83d7-39f2a469a387: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d430ca86-f645-428c-83d7-39f2a469a387', 'volume_size': 1} Jul 17 19:37:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:37:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:37:55 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c64162b1-53fa-4cf0-b17a-114848d0dae9,created_at=2026-07-17T17:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1232985009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c64162b1-53fa-4cf0-b17a-114848d0dae9,host='devstack@QuobyteHD#QuobyteHD',id=d430ca86-f645-428c-83d7-39f2a469a387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95c964b3968d4c4bb6ca9fc77677ddeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:37:56Z,use_quota=True,user_id='41b66c5b70d844f68cdc843bf3754d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47e3e7e3-f596-4333-a8bb-e2d162c1f266),volume_type_id=47e3e7e3-f596-4333-a8bb-e2d162c1f266)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:37:55 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] Creating volume d430ca86-f645-428c-83d7-39f2a469a387 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:37:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:37:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:37:55 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:37:55 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:37:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:37:55 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:37:55 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:37:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:55 devstack sudo[89460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387 1073741824 Jul 17 19:37:55 devstack sudo[89460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:56 devstack sudo[89460]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387 1073741824" returned: 0 in 0.611s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:37:56 devstack sudo[89466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387 Jul 17 19:37:56 devstack sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:37:56 devstack sudo[89466]: pam_unix(sudo:session): session closed for user root Jul 17 19:37:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387" returned: 0 in 0.455s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:37:56 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:37:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:37:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe848b7-cc2a-404f-843f-f5ecf8f4b2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d430ca86-f645-428c-83d7-39f2a469a387', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52582592-6653-4688-a620-eed6ba491b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:37:56 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] Volume volume-d430ca86-f645-428c-83d7-39f2a469a387 (d430ca86-f645-428c-83d7-39f2a469a387): created successfully Jul 17 19:37:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52582592-6653-4688-a620-eed6ba491b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:37:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] Flow 'volume_create_manager' (a9f467ee-d85f-46d5-b709-43a2a8e8bb07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:37:57 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-6fbe4bbb-7ab6-42ab-8cf2-c5894520704b tempest-GroupSnapshotsTest-218644072 None] Created volume successfully. Jul 17 19:37:58 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-9f3a9bbf-6cde-409c-bc02-d4b5e6d2252b tempest-GroupSnapshotsTest-218644072 None] Update group completed successfully. Jul 17 19:37:59 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-ebce773d-8f0f-465c-a4d7-b1cc3df5f29d tempest-GroupSnapshotsTest-218644072 None] Update group completed successfully. Jul 17 19:38:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-2ecd613b-93c0-45be-a8b5-5800eb301204 req-46982b65-e67a-40f5-8799-715b05424954 tempest-ServerActionsTestOtherA-2088443176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:38:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-2ecd613b-93c0-45be-a8b5-5800eb301204 req-46982b65-e67a-40f5-8799-715b05424954 tempest-ServerActionsTestOtherA-2088443176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:38:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-2ecd613b-93c0-45be-a8b5-5800eb301204 req-46982b65-e67a-40f5-8799-715b05424954 tempest-ServerActionsTestOtherA-2088443176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:38:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-2ecd613b-93c0-45be-a8b5-5800eb301204 req-46982b65-e67a-40f5-8799-715b05424954 tempest-ServerActionsTestOtherA-2088443176 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55', 'name': 'volume-5237f408-9530-4077-ada7-4cc2eda94a2f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '30b7cc8f-83f5-4afd-a199-d1d738bb6284', 'enforce_multipath': True} {{(pid=87726) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 19:38:00 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-2ecd613b-93c0-45be-a8b5-5800eb301204 req-46982b65-e67a-40f5-8799-715b05424954 tempest-ServerActionsTestOtherA-2088443176 None] attachment_update completed successfully. Jul 17 19:38:01 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-3416325c-46df-4683-b565-d0105f23ad65 tempest-GroupSnapshotsTest-218644072 None] Update group completed successfully. Jul 17 19:38:02 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:UPDATE=68,cinder:SELECT=85,cinder:INSERT=13,cinder:DELETE=1 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:38:02 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-8a35862f-d2d3-4c4a-80d6-002ddf5bf493 tempest-GroupSnapshotsTest-218644072 None] Update group completed successfully. Jul 17 19:38:03 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] GroupSnapshot 7598c572-ee97-4e70-b501-17dc8fd976cc: creating. Jul 17 19:38:03 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=77,cinder:UPDATE=78,cinder:DELETE=7,cinder:INSERT=16 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:38:03 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] Group snapshot 7598c572-ee97-4e70-b501-17dc8fd976cc: creating. {{(pid=87726) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 17 19:38:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:38:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:38:03 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] Creating offline snapshot 616f8b38-479f-4b86-8c74-21fdd0ef697a of volume 8d2edfc7-d516-4358-aee2-4d2b1c3c0574 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:38:03 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[066a8a53-7d25-440c-830a-0484f2e97d77]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:38:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:04 devstack sudo[89869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574 Jul 17 19:38:04 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:04 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574" returned: 0 in 0.370s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574.616f8b38-479f-4b86-8c74-21fdd0ef697a 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:04 devstack sudo[89874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574.616f8b38-479f-4b86-8c74-21fdd0ef697a 1G Jul 17 19:38:04 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:04 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574.616f8b38-479f-4b86-8c74-21fdd0ef697a 1G" returned: 0 in 0.518s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574.616f8b38-479f-4b86-8c74-21fdd0ef697a {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:04 devstack sudo[89880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574.616f8b38-479f-4b86-8c74-21fdd0ef697a Jul 17 19:38:04 devstack sudo[89880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:05 devstack sudo[89880]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574.616f8b38-479f-4b86-8c74-21fdd0ef697a" returned: 0 in 0.344s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:05 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574.616f8b38-479f-4b86-8c74-21fdd0ef697a is being set with open permissions: ugo+rw: NotImplementedError Jul 17 19:38:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574.616f8b38-479f-4b86-8c74-21fdd0ef697a {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:05 devstack sudo[89885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574.616f8b38-479f-4b86-8c74-21fdd0ef697a Jul 17 19:38:05 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:05 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574.616f8b38-479f-4b86-8c74-21fdd0ef697a" returned: 0 in 0.424s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:05 devstack sudo[89888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574.info Jul 17 19:38:05 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:06 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574.info" returned: 0 in 0.480s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:06 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574.info is being set with open permissions: ugo+rw: NotImplementedError Jul 17 19:38:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:06 devstack sudo[89894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574.info Jul 17 19:38:06 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:06 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574.info" returned: 0 in 0.319s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.582s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:38:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:38:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:38:06 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] Creating offline snapshot c61ae0d6-f7e4-41e1-abe0-c7fd0aac917e of volume d430ca86-f645-428c-83d7-39f2a469a387 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:38:06 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7845e64-13b1-4a40-b1e6-be0d16391d1c]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:38:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:06 devstack sudo[89898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387 Jul 17 19:38:06 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:07 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387" returned: 0 in 0.452s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387.c61ae0d6-f7e4-41e1-abe0-c7fd0aac917e 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:07 devstack sudo[89909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387.c61ae0d6-f7e4-41e1-abe0-c7fd0aac917e 1G Jul 17 19:38:07 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:07 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-e5818f9f-1d47-4785-ac1d-002af8a9dac2 req-ca6cbcc6-bcc6-4645-b8e2-6f610382ce1a tempest-ServerActionsTestOtherA-2088443176 None] Terminate volume connection completed successfully. Jul 17 19:38:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-e5818f9f-1d47-4785-ac1d-002af8a9dac2 req-ca6cbcc6-bcc6-4645-b8e2-6f610382ce1a tempest-ServerActionsTestOtherA-2088443176 None] Deleting attachment 30b7cc8f-83f5-4afd-a199-d1d738bb6284. {{(pid=87726) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 19:38:07 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387.c61ae0d6-f7e4-41e1-abe0-c7fd0aac917e 1G" returned: 0 in 0.729s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d430ca86-f645-428c-83d7-39f2a469a387 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387.c61ae0d6-f7e4-41e1-abe0-c7fd0aac917e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:07 devstack sudo[89957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d430ca86-f645-428c-83d7-39f2a469a387 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387.c61ae0d6-f7e4-41e1-abe0-c7fd0aac917e Jul 17 19:38:07 devstack sudo[89957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-e5818f9f-1d47-4785-ac1d-002af8a9dac2 req-1aa46bfa-f7e5-4666-9db9-03ded36e7961 tempest-ServerActionsTestOtherA-2088443176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:38:08 devstack sudo[89957]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d430ca86-f645-428c-83d7-39f2a469a387 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387.c61ae0d6-f7e4-41e1-abe0-c7fd0aac917e" returned: 0 in 0.457s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:08 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387.c61ae0d6-f7e4-41e1-abe0-c7fd0aac917e is being set with open permissions: ugo+rw: NotImplementedError Jul 17 19:38:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387.c61ae0d6-f7e4-41e1-abe0-c7fd0aac917e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:08 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387.c61ae0d6-f7e4-41e1-abe0-c7fd0aac917e Jul 17 19:38:08 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:08 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387.c61ae0d6-f7e4-41e1-abe0-c7fd0aac917e" returned: 0 in 0.284s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:08 devstack sudo[89978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387.info Jul 17 19:38:08 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:08 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387.info" returned: 0 in 0.329s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:08 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387.info is being set with open permissions: ugo+rw: NotImplementedError Jul 17 19:38:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:08 devstack sudo[89984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387.info Jul 17 19:38:08 devstack sudo[89984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:09 devstack sudo[89984]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387.info" returned: 0 in 0.419s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.805s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:38:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-e5818f9f-1d47-4785-ac1d-002af8a9dac2 req-1aa46bfa-f7e5-4666-9db9-03ded36e7961 tempest-ServerActionsTestOtherA-2088443176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.258s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:38:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-e5818f9f-1d47-4785-ac1d-002af8a9dac2 req-1aa46bfa-f7e5-4666-9db9-03ded36e7961 tempest-ServerActionsTestOtherA-2088443176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:38:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-e5818f9f-1d47-4785-ac1d-002af8a9dac2 req-1aa46bfa-f7e5-4666-9db9-03ded36e7961 tempest-ServerActionsTestOtherA-2088443176 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55', 'name': 'volume-5237f408-9530-4077-ada7-4cc2eda94a2f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '548004e9-6d75-4ffb-9379-b212c2d6c757', 'enforce_multipath': True} {{(pid=87726) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 19:38:09 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-e5818f9f-1d47-4785-ac1d-002af8a9dac2 req-1aa46bfa-f7e5-4666-9db9-03ded36e7961 tempest-ServerActionsTestOtherA-2088443176 None] attachment_update completed successfully. Jul 17 19:38:09 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-4745c3c0-895e-4a77-a056-fb57252de357 tempest-GroupSnapshotsTest-218644072 None] group_snapshot 7598c572-ee97-4e70-b501-17dc8fd976cc: created successfully Jul 17 19:38:10 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] group_snapshot 7598c572-ee97-4e70-b501-17dc8fd976cc: deleting Jul 17 19:38:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] group_snapshot 7598c572-ee97-4e70-b501-17dc8fd976cc: deleting {{(pid=87726) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 17 19:38:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "cinder-quobyte-8d2edfc7-d516-4358-aee2-4d2b1c3c0574" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:38:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] Lock "cinder-quobyte-8d2edfc7-d516-4358-aee2-4d2b1c3c0574" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:38:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "cinder-quobyte-616f8b38-479f-4b86-8c74-21fdd0ef697a" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:38:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] Lock "cinder-quobyte-616f8b38-479f-4b86-8c74-21fdd0ef697a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:38:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] Deleting offline snapshot 616f8b38-479f-4b86-8c74-21fdd0ef697a of volume 8d2edfc7-d516-4358-aee2-4d2b1c3c0574 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:38:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] snapshot_file for this snap is: volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574.616f8b38-479f-4b86-8c74-21fdd0ef697a {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:38:10 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[589233bf-ddd0-4d85-8c60-9f5446c28eb3]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:38:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574.616f8b38-479f-4b86-8c74-21fdd0ef697a {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:11 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574.616f8b38-479f-4b86-8c74-21fdd0ef697a Jul 17 19:38:11 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:11 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574.616f8b38-479f-4b86-8c74-21fdd0ef697a" returned: 0 in 0.720s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:38:11 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[410d0d3b-fc55-4a48-ac81-77147e899827]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:38:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:11 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574 Jul 17 19:38:11 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:12 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574" returned: 0 in 0.534s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574.616f8b38-479f-4b86-8c74-21fdd0ef697a {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:12 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574.616f8b38-479f-4b86-8c74-21fdd0ef697a Jul 17 19:38:12 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:12 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574.616f8b38-479f-4b86-8c74-21fdd0ef697a" returned: 0 in 0.567s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574.616f8b38-479f-4b86-8c74-21fdd0ef697a {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:12 devstack sudo[90441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574.616f8b38-479f-4b86-8c74-21fdd0ef697a Jul 17 19:38:12 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:12 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574.616f8b38-479f-4b86-8c74-21fdd0ef697a" returned: 0 in 0.337s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] Lock "cinder-quobyte-616f8b38-479f-4b86-8c74-21fdd0ef697a" released by "_delete_snapshot" :: held 2.327s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:38:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] Lock "cinder-quobyte-8d2edfc7-d516-4358-aee2-4d2b1c3c0574" released by "delete_snapshot" :: held 2.357s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:38:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "cinder-quobyte-d430ca86-f645-428c-83d7-39f2a469a387" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:38:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] Lock "cinder-quobyte-d430ca86-f645-428c-83d7-39f2a469a387" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:38:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "cinder-quobyte-c61ae0d6-f7e4-41e1-abe0-c7fd0aac917e" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:38:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] Lock "cinder-quobyte-c61ae0d6-f7e4-41e1-abe0-c7fd0aac917e" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:38:13 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] Deleting offline snapshot c61ae0d6-f7e4-41e1-abe0-c7fd0aac917e of volume d430ca86-f645-428c-83d7-39f2a469a387 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:38:13 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] snapshot_file for this snap is: volume-d430ca86-f645-428c-83d7-39f2a469a387.c61ae0d6-f7e4-41e1-abe0-c7fd0aac917e {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:38:13 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0570c1d-1dad-4c1f-b720-ff61ebadd7e3]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:38:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387.c61ae0d6-f7e4-41e1-abe0-c7fd0aac917e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:13 devstack sudo[90448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387.c61ae0d6-f7e4-41e1-abe0-c7fd0aac917e Jul 17 19:38:13 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:13 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387.c61ae0d6-f7e4-41e1-abe0-c7fd0aac917e" returned: 0 in 0.740s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:13 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d430ca86-f645-428c-83d7-39f2a469a387(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:38:13 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33dda26-191f-4b9c-8a4d-0506a14d80f5]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:38:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:14 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387 Jul 17 19:38:14 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:14 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387" returned: 0 in 0.627s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387.c61ae0d6-f7e4-41e1-abe0-c7fd0aac917e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:14 devstack sudo[90459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387.c61ae0d6-f7e4-41e1-abe0-c7fd0aac917e Jul 17 19:38:14 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:15 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387.c61ae0d6-f7e4-41e1-abe0-c7fd0aac917e" returned: 0 in 0.637s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387.c61ae0d6-f7e4-41e1-abe0-c7fd0aac917e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:38:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:38:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:38:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:38:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:38:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:38:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:15 devstack sudo[90465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387.c61ae0d6-f7e4-41e1-abe0-c7fd0aac917e Jul 17 19:38:15 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:15 devstack sudo[90466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:38:15 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:15 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.590s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:15 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:38:15 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387.c61ae0d6-f7e4-41e1-abe0-c7fd0aac917e" returned: 0 in 0.720s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] Lock "cinder-quobyte-c61ae0d6-f7e4-41e1-abe0-c7fd0aac917e" released by "_delete_snapshot" :: held 2.953s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:38:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] Lock "cinder-quobyte-d430ca86-f645-428c-83d7-39f2a469a387" released by "delete_snapshot" :: held 3.003s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:38:16 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:38:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] Flow 'volume_create_manager' (669cbc4b-8104-43ae-9bc1-c61f106e0e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:38:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d6ed9d-fd55-4023-865c-fd34d9c1e9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:38:16 devstack cinder-volume[87726]: WARNING cinder.quota [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-734871378 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-734871378, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:38:16 devstack cinder-volume[87726]: WARNING cinder.quota [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-734871378 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-734871378, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:38:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d6ed9d-fd55-4023-865c-fd34d9c1e9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-401848622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b3e0663-8da6-42ef-aa25-b77fb3c15c15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4cf2c0669b44cf68803ceb9bb980aef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:38:16Z,use_quota=True,user_id='821cd0fd9db8446595629ef91560ec5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:38:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8263f50-69d7-42ed-b803-ef02283e5969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:38:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8263f50-69d7-42ed-b803-ef02283e5969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:38:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9973788-0d77-4633-ae42-9b672676fbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:38:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9973788-0d77-4633-ae42-9b672676fbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b3e0663-8da6-42ef-aa25-b77fb3c15c15', 'volume_name': 'volume-9b3e0663-8da6-42ef-aa25-b77fb3c15c15', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:38:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f524d627-55d4-4e68-b710-d40d698eaf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:38:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f524d627-55d4-4e68-b710-d40d698eaf9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:38:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d46f00-0432-4c50-8c9a-c368ec6405ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:38:16 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] Volume 9b3e0663-8da6-42ef-aa25-b77fb3c15c15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b3e0663-8da6-42ef-aa25-b77fb3c15c15', 'volume_size': 1} Jul 17 19:38:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:38:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:38:16 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-401848622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b3e0663-8da6-42ef-aa25-b77fb3c15c15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4cf2c0669b44cf68803ceb9bb980aef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:38:16Z,use_quota=True,user_id='821cd0fd9db8446595629ef91560ec5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:38:16 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] Creating volume 9b3e0663-8da6-42ef-aa25-b77fb3c15c15 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:38:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:38:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:38:16 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:38:16 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:38:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:38:16 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:38:16 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:38:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9b3e0663-8da6-42ef-aa25-b77fb3c15c15 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:16 devstack sudo[90473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9b3e0663-8da6-42ef-aa25-b77fb3c15c15 1073741824 Jul 17 19:38:16 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:16 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] Created reservations ['ea0d9352-3ad7-4eca-97c2-e3127d35c97c', '3d8080c7-b33f-4e0a-b1b0-4a54a7402156', '41681079-48f0-4315-846e-bbe4a56c6fc8', '2f0ee1fa-9e68-46a3-9db4-308a6c4b3a64'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:38:16 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] Created reservations ['f9ea2986-3793-4500-bc72-03fae29ec771', '51bd7e86-68bd-4f43-9a76-b45495204553', '0b402280-da44-4c5d-934a-30c29ffe0c95', 'c8a55e1b-ba4f-4620-86fe-6d5aecfda75d'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:38:16 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-d0f8b4ef-b6d5-4922-9a95-5f6fc0c9438c tempest-GroupSnapshotsTest-218644072 None] group_snapshot 7598c572-ee97-4e70-b501-17dc8fd976cc: deleted successfully Jul 17 19:38:17 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9b3e0663-8da6-42ef-aa25-b77fb3c15c15 1073741824" returned: 0 in 0.831s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9b3e0663-8da6-42ef-aa25-b77fb3c15c15 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:17 devstack sudo[90480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9b3e0663-8da6-42ef-aa25-b77fb3c15c15 Jul 17 19:38:17 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:17 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9b3e0663-8da6-42ef-aa25-b77fb3c15c15" returned: 0 in 0.327s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:17 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:38:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:38:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d46f00-0432-4c50-8c9a-c368ec6405ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b3e0663-8da6-42ef-aa25-b77fb3c15c15', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:38:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab2a927a-54bb-4b74-9ffe-27549371da37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:38:17 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] Volume volume-9b3e0663-8da6-42ef-aa25-b77fb3c15c15 (9b3e0663-8da6-42ef-aa25-b77fb3c15c15): created successfully Jul 17 19:38:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab2a927a-54bb-4b74-9ffe-27549371da37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:38:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] Flow 'volume_create_manager' (669cbc4b-8104-43ae-9bc1-c61f106e0e14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:38:17 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-30ca2781-431d-4d65-a39e-c4dca5cc5c3c tempest-TaggedAttachmentsTest-887101203 None] Created volume successfully. Jul 17 19:38:18 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7bc105bd-acc6-45a3-9267-dbd72c3099a1 tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "cinder-quobyte-8d2edfc7-d516-4358-aee2-4d2b1c3c0574" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:38:18 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7bc105bd-acc6-45a3-9267-dbd72c3099a1 tempest-GroupSnapshotsTest-218644072 None] Lock "cinder-quobyte-8d2edfc7-d516-4358-aee2-4d2b1c3c0574" acquired by "delete_volume" :: waited 0.047s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:38:18 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e19011-fb95-49af-b1cb-0349a63f1b94]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:38:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7bc105bd-acc6-45a3-9267-dbd72c3099a1 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:18 devstack sudo[90485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574 Jul 17 19:38:18 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:19 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7bc105bd-acc6-45a3-9267-dbd72c3099a1 tempest-GroupSnapshotsTest-218644072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574" returned: 0 in 0.622s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7bc105bd-acc6-45a3-9267-dbd72c3099a1 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:19 devstack sudo[90492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574 Jul 17 19:38:19 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:19 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7bc105bd-acc6-45a3-9267-dbd72c3099a1 tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8d2edfc7-d516-4358-aee2-4d2b1c3c0574" returned: 0 in 0.359s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:19 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7bc105bd-acc6-45a3-9267-dbd72c3099a1 tempest-GroupSnapshotsTest-218644072 None] Lock "cinder-quobyte-8d2edfc7-d516-4358-aee2-4d2b1c3c0574" released by "delete_volume" :: held 1.153s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:38:19 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7bc105bd-acc6-45a3-9267-dbd72c3099a1 tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "cinder-quobyte-d430ca86-f645-428c-83d7-39f2a469a387" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:38:19 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7bc105bd-acc6-45a3-9267-dbd72c3099a1 tempest-GroupSnapshotsTest-218644072 None] Lock "cinder-quobyte-d430ca86-f645-428c-83d7-39f2a469a387" acquired by "delete_volume" :: waited 0.030s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:38:19 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e7dbfe-248e-4a90-99ab-0a54bfe4edb1]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:38:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7bc105bd-acc6-45a3-9267-dbd72c3099a1 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:19 devstack sudo[90498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387 Jul 17 19:38:19 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:20 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7bc105bd-acc6-45a3-9267-dbd72c3099a1 tempest-GroupSnapshotsTest-218644072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387" returned: 0 in 0.542s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7bc105bd-acc6-45a3-9267-dbd72c3099a1 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:20 devstack sudo[90506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387 Jul 17 19:38:20 devstack sudo[90506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:20 devstack sudo[90506]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7bc105bd-acc6-45a3-9267-dbd72c3099a1 tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d430ca86-f645-428c-83d7-39f2a469a387" returned: 0 in 0.340s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:20 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7bc105bd-acc6-45a3-9267-dbd72c3099a1 tempest-GroupSnapshotsTest-218644072 None] Lock "cinder-quobyte-d430ca86-f645-428c-83d7-39f2a469a387" released by "delete_volume" :: held 0.997s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:38:20 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-7bc105bd-acc6-45a3-9267-dbd72c3099a1 tempest-GroupSnapshotsTest-218644072 None] Created reservations ['ca1083c7-e26d-420b-a999-a562936b6d9d'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:38:20 devstack cinder-volume[87726]: WARNING cinder.quota [None req-7bc105bd-acc6-45a3-9267-dbd72c3099a1 tempest-GroupSnapshotsTest-218644072 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-734871378 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-734871378, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:38:20 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-7bc105bd-acc6-45a3-9267-dbd72c3099a1 tempest-GroupSnapshotsTest-218644072 None] Created reservations ['eac3b052-9023-4f0a-af7d-4f6032bdd104', '588ccff3-ff88-4ea9-bfcf-f77abb68cfcc', 'c0f97da4-4c67-43ed-9240-efce7a19935d', '50a8a3f9-46b3-4bb0-9ac1-aebe14d19bec'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:38:21 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-7bc105bd-acc6-45a3-9267-dbd72c3099a1 tempest-GroupSnapshotsTest-218644072 None] Created reservations ['0121e567-168b-495d-ac8f-fbe2cea85f70', '43cefc26-0810-4b00-922d-1cb737edc837', '93d9b643-25e1-4419-8361-437a1e394c5e', '7cf47b5f-879c-4fe8-a8cc-2d04af620d5d'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:38:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7bc105bd-acc6-45a3-9267-dbd72c3099a1 tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:38:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7bc105bd-acc6-45a3-9267-dbd72c3099a1 tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:38:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7bc105bd-acc6-45a3-9267-dbd72c3099a1 tempest-GroupSnapshotsTest-218644072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:38:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7bc105bd-acc6-45a3-9267-dbd72c3099a1 tempest-GroupSnapshotsTest-218644072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:38:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7bc105bd-acc6-45a3-9267-dbd72c3099a1 tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:38:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7bc105bd-acc6-45a3-9267-dbd72c3099a1 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:21 devstack sudo[90511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:38:21 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:21 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7bc105bd-acc6-45a3-9267-dbd72c3099a1 tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.360s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:21 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-7bc105bd-acc6-45a3-9267-dbd72c3099a1 tempest-GroupSnapshotsTest-218644072 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:38:21 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-7bc105bd-acc6-45a3-9267-dbd72c3099a1 tempest-GroupSnapshotsTest-218644072 None] Delete group completed successfully. Jul 17 19:38:22 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-dbb1d7a4-bd98-4d9d-92a6-17c869d333ff tempest-GroupSnapshotsTest-218644072 None] Group tempest-GroupSnapshotsTest-Group-470630508: creating Jul 17 19:38:22 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-dbb1d7a4-bd98-4d9d-92a6-17c869d333ff tempest-GroupSnapshotsTest-218644072 None] Group tempest-GroupSnapshotsTest-Group-470630508: created successfully Jul 17 19:38:22 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-dbb1d7a4-bd98-4d9d-92a6-17c869d333ff tempest-GroupSnapshotsTest-218644072 None] Create group completed successfully. Jul 17 19:38:23 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:38:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] Flow 'volume_create_manager' (d050a0b3-2653-4a83-a5d9-77465a6c5326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:38:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (779d4aa1-04f4-4067-9931-efa77f64c78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:38:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (779d4aa1-04f4-4067-9931-efa77f64c78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-151606455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7458153b-c122-4a3c-a487-c02b6c43c42b,host='devstack@QuobyteHD#QuobyteHD',id=5815214f-7403-40e6-ba69-c585dbee7d82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95c964b3968d4c4bb6ca9fc77677ddeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:38:24Z,use_quota=True,user_id='41b66c5b70d844f68cdc843bf3754d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1adde841-18fa-41a9-8810-82446cf8e423),volume_type_id=1adde841-18fa-41a9-8810-82446cf8e423)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:38:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f082decc-0e60-4d18-ba1c-fde066b63f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:38:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f082decc-0e60-4d18-ba1c-fde066b63f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:38:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b57fc9b-0bca-4630-a3da-f5036eafafce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:38:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b57fc9b-0bca-4630-a3da-f5036eafafce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5815214f-7403-40e6-ba69-c585dbee7d82', 'volume_name': 'volume-5815214f-7403-40e6-ba69-c585dbee7d82', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:38:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddcec9ae-bfb9-4c1d-8042-0df8cb09a24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:38:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddcec9ae-bfb9-4c1d-8042-0df8cb09a24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:38:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d786dbf0-ce36-48b2-862e-c65b3b3616cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:38:24 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] Volume 5815214f-7403-40e6-ba69-c585dbee7d82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5815214f-7403-40e6-ba69-c585dbee7d82', 'volume_size': 1} Jul 17 19:38:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:38:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:38:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7458153b-c122-4a3c-a487-c02b6c43c42b,created_at=2026-07-17T17:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-151606455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7458153b-c122-4a3c-a487-c02b6c43c42b,host='devstack@QuobyteHD#QuobyteHD',id=5815214f-7403-40e6-ba69-c585dbee7d82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95c964b3968d4c4bb6ca9fc77677ddeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:38:24Z,use_quota=True,user_id='41b66c5b70d844f68cdc843bf3754d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1adde841-18fa-41a9-8810-82446cf8e423),volume_type_id=1adde841-18fa-41a9-8810-82446cf8e423)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:38:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] Creating volume 5815214f-7403-40e6-ba69-c585dbee7d82 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:38:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:38:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:38:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:38:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:38:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:38:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:38:24 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:38:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:24 devstack sudo[90548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82 1073741824 Jul 17 19:38:24 devstack sudo[90548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:24 devstack sudo[90548]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82 1073741824" returned: 0 in 0.669s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:24 devstack sudo[90557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82 Jul 17 19:38:24 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:25 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82" returned: 0 in 0.522s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:38:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:38:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d786dbf0-ce36-48b2-862e-c65b3b3616cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5815214f-7403-40e6-ba69-c585dbee7d82', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:38:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c38167d-ab68-4e2d-ab29-0752cb824cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:38:25 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] Volume volume-5815214f-7403-40e6-ba69-c585dbee7d82 (5815214f-7403-40e6-ba69-c585dbee7d82): created successfully Jul 17 19:38:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c38167d-ab68-4e2d-ab29-0752cb824cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:38:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] Flow 'volume_create_manager' (d050a0b3-2653-4a83-a5d9-77465a6c5326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:38:25 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-96484e0b-55c9-47ee-b177-79bca777c4b0 tempest-GroupSnapshotsTest-218644072 None] Created volume successfully. Jul 17 19:38:27 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e07ee722-ded6-48dc-9f09-7a6e8cb7b60e tempest-GroupSnapshotsTest-218644072 None] GroupSnapshot 0190ee78-7bd5-45bd-8c3b-4c0f1d3dfe9c: creating. Jul 17 19:38:27 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e07ee722-ded6-48dc-9f09-7a6e8cb7b60e tempest-GroupSnapshotsTest-218644072 None] Group snapshot 0190ee78-7bd5-45bd-8c3b-4c0f1d3dfe9c: creating. {{(pid=87726) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 17 19:38:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e07ee722-ded6-48dc-9f09-7a6e8cb7b60e tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:38:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e07ee722-ded6-48dc-9f09-7a6e8cb7b60e tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:38:27 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-e07ee722-ded6-48dc-9f09-7a6e8cb7b60e tempest-GroupSnapshotsTest-218644072 None] Creating offline snapshot 787cc51f-25d1-4767-91b7-5734958cc3db of volume 5815214f-7403-40e6-ba69-c585dbee7d82 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:38:27 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74620ed-af0b-40b6-8176-9e22e6e6adc4]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:38:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e07ee722-ded6-48dc-9f09-7a6e8cb7b60e tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:27 devstack sudo[90670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82 Jul 17 19:38:27 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:27 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e07ee722-ded6-48dc-9f09-7a6e8cb7b60e tempest-GroupSnapshotsTest-218644072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82" returned: 0 in 0.703s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e07ee722-ded6-48dc-9f09-7a6e8cb7b60e tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82.787cc51f-25d1-4767-91b7-5734958cc3db 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:28 devstack sudo[90690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82.787cc51f-25d1-4767-91b7-5734958cc3db 1G Jul 17 19:38:28 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:28 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e07ee722-ded6-48dc-9f09-7a6e8cb7b60e tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82.787cc51f-25d1-4767-91b7-5734958cc3db 1G" returned: 0 in 0.668s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e07ee722-ded6-48dc-9f09-7a6e8cb7b60e tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5815214f-7403-40e6-ba69-c585dbee7d82 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82.787cc51f-25d1-4767-91b7-5734958cc3db {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:28 devstack sudo[90700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5815214f-7403-40e6-ba69-c585dbee7d82 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82.787cc51f-25d1-4767-91b7-5734958cc3db Jul 17 19:38:28 devstack sudo[90700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:28 devstack sudo[90700]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e07ee722-ded6-48dc-9f09-7a6e8cb7b60e tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5815214f-7403-40e6-ba69-c585dbee7d82 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82.787cc51f-25d1-4767-91b7-5734958cc3db" returned: 0 in 0.340s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:28 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-e07ee722-ded6-48dc-9f09-7a6e8cb7b60e tempest-GroupSnapshotsTest-218644072 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82.787cc51f-25d1-4767-91b7-5734958cc3db is being set with open permissions: ugo+rw: NotImplementedError Jul 17 19:38:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e07ee722-ded6-48dc-9f09-7a6e8cb7b60e tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82.787cc51f-25d1-4767-91b7-5734958cc3db {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:29 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82.787cc51f-25d1-4767-91b7-5734958cc3db Jul 17 19:38:29 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:29 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e07ee722-ded6-48dc-9f09-7a6e8cb7b60e tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82.787cc51f-25d1-4767-91b7-5734958cc3db" returned: 0 in 0.363s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e07ee722-ded6-48dc-9f09-7a6e8cb7b60e tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:29 devstack sudo[90709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82.info Jul 17 19:38:29 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:29 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e07ee722-ded6-48dc-9f09-7a6e8cb7b60e tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82.info" returned: 0 in 0.404s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:29 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-e07ee722-ded6-48dc-9f09-7a6e8cb7b60e tempest-GroupSnapshotsTest-218644072 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82.info is being set with open permissions: ugo+rw: NotImplementedError Jul 17 19:38:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e07ee722-ded6-48dc-9f09-7a6e8cb7b60e tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:29 devstack sudo[90712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82.info Jul 17 19:38:29 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:30 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e07ee722-ded6-48dc-9f09-7a6e8cb7b60e tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82.info" returned: 0 in 0.418s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e07ee722-ded6-48dc-9f09-7a6e8cb7b60e tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:38:30 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:38:30 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] Flow 'volume_create_manager' (b5c3f9e7-444d-46eb-a9e9-09f0856eb35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:38:30 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f16490f7-8a9f-4ef7-9780-fa8a0da2f312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:38:30 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f16490f7-8a9f-4ef7-9780-fa8a0da2f312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1207923976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f48b0eb-f463-436e-9e39-3d83a353c682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de5210d017174a79be25ac1e59f53f9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:38:30Z,use_quota=True,user_id='178f6a4fd64047bfb394a1305a7d56a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:38:30 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfebbf26-a023-44c7-ab0f-1e903357acc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:38:30 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfebbf26-a023-44c7-ab0f-1e903357acc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:38:30 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3bbb244-ab45-45c1-b307-ad18c79c1eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:38:30 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3bbb244-ab45-45c1-b307-ad18c79c1eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f48b0eb-f463-436e-9e39-3d83a353c682', 'volume_name': 'volume-2f48b0eb-f463-436e-9e39-3d83a353c682', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:38:30 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b2ebbf9-1a09-4262-acb6-88bac7ee42cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:38:30 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b2ebbf9-1a09-4262-acb6-88bac7ee42cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:38:30 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ffc5b79-dbe8-4dea-bdc2-7a0c40ea6367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:38:30 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] Volume 2f48b0eb-f463-436e-9e39-3d83a353c682: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f48b0eb-f463-436e-9e39-3d83a353c682', 'volume_size': 1} Jul 17 19:38:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:38:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:38:30 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1207923976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f48b0eb-f463-436e-9e39-3d83a353c682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de5210d017174a79be25ac1e59f53f9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:38:30Z,use_quota=True,user_id='178f6a4fd64047bfb394a1305a7d56a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:38:30 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] Creating volume 2f48b0eb-f463-436e-9e39-3d83a353c682 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:38:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:38:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:38:30 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:38:30 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:38:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:38:30 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:38:30 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:38:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2f48b0eb-f463-436e-9e39-3d83a353c682 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:30 devstack sudo[90717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2f48b0eb-f463-436e-9e39-3d83a353c682 1073741824 Jul 17 19:38:30 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:30 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e07ee722-ded6-48dc-9f09-7a6e8cb7b60e tempest-GroupSnapshotsTest-218644072 None] group_snapshot 0190ee78-7bd5-45bd-8c3b-4c0f1d3dfe9c: created successfully Jul 17 19:38:31 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2f48b0eb-f463-436e-9e39-3d83a353c682 1073741824" returned: 0 in 0.897s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2f48b0eb-f463-436e-9e39-3d83a353c682 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:31 devstack sudo[90779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2f48b0eb-f463-436e-9e39-3d83a353c682 Jul 17 19:38:31 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:32 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2f48b0eb-f463-436e-9e39-3d83a353c682" returned: 0 in 0.754s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:32 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:38:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:38:32 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-b12af381-f47e-4a93-85f3-c878fde0005f tempest-GroupSnapshotsTest-218644072 None] group_snapshot 0190ee78-7bd5-45bd-8c3b-4c0f1d3dfe9c: deleting Jul 17 19:38:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ffc5b79-dbe8-4dea-bdc2-7a0c40ea6367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f48b0eb-f463-436e-9e39-3d83a353c682', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:38:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbbd4e2c-c1a3-4181-b184-c75867969565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:38:32 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] Volume volume-2f48b0eb-f463-436e-9e39-3d83a353c682 (2f48b0eb-f463-436e-9e39-3d83a353c682): created successfully Jul 17 19:38:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbbd4e2c-c1a3-4181-b184-c75867969565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:38:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] Flow 'volume_create_manager' (b5c3f9e7-444d-46eb-a9e9-09f0856eb35d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:38:32 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-88035bce-9bfa-4642-bf99-0cc6d62b14a4 tempest-VolumesAdminNegativeTest-376871872 None] Created volume successfully. Jul 17 19:38:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b12af381-f47e-4a93-85f3-c878fde0005f tempest-GroupSnapshotsTest-218644072 None] group_snapshot 0190ee78-7bd5-45bd-8c3b-4c0f1d3dfe9c: deleting {{(pid=87726) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 17 19:38:32 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-b12af381-f47e-4a93-85f3-c878fde0005f tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "cinder-quobyte-5815214f-7403-40e6-ba69-c585dbee7d82" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:38:32 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-b12af381-f47e-4a93-85f3-c878fde0005f tempest-GroupSnapshotsTest-218644072 None] Lock "cinder-quobyte-5815214f-7403-40e6-ba69-c585dbee7d82" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:38:32 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-b12af381-f47e-4a93-85f3-c878fde0005f tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "cinder-quobyte-787cc51f-25d1-4767-91b7-5734958cc3db" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:38:32 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-b12af381-f47e-4a93-85f3-c878fde0005f tempest-GroupSnapshotsTest-218644072 None] Lock "cinder-quobyte-787cc51f-25d1-4767-91b7-5734958cc3db" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:38:32 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-b12af381-f47e-4a93-85f3-c878fde0005f tempest-GroupSnapshotsTest-218644072 None] Deleting offline snapshot 787cc51f-25d1-4767-91b7-5734958cc3db of volume 5815214f-7403-40e6-ba69-c585dbee7d82 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:38:32 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-b12af381-f47e-4a93-85f3-c878fde0005f tempest-GroupSnapshotsTest-218644072 None] snapshot_file for this snap is: volume-5815214f-7403-40e6-ba69-c585dbee7d82.787cc51f-25d1-4767-91b7-5734958cc3db {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:38:32 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b35a29-ba06-41c7-be5d-a4bdd5ec7019]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:38:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b12af381-f47e-4a93-85f3-c878fde0005f tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82.787cc51f-25d1-4767-91b7-5734958cc3db {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:32 devstack sudo[90819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82.787cc51f-25d1-4767-91b7-5734958cc3db Jul 17 19:38:32 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:32 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-71b8689a-d0d7-4288-b39e-5af56fc14b48 tempest-VolumesAdminNegativeTest-376871872 None] Acquiring lock "cinder-2f48b0eb-f463-436e-9e39-3d83a353c682-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:38:32 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-71b8689a-d0d7-4288-b39e-5af56fc14b48 tempest-VolumesAdminNegativeTest-376871872 None] Lock "cinder-2f48b0eb-f463-436e-9e39-3d83a353c682-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:38:32 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b12af381-f47e-4a93-85f3-c878fde0005f tempest-GroupSnapshotsTest-218644072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82.787cc51f-25d1-4767-91b7-5734958cc3db" returned: 0 in 0.547s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:32 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-b12af381-f47e-4a93-85f3-c878fde0005f tempest-GroupSnapshotsTest-218644072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5815214f-7403-40e6-ba69-c585dbee7d82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:38:33 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e920c9-3ec3-428c-b814-f93d314e1f8e]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:38:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b12af381-f47e-4a93-85f3-c878fde0005f tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:33 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-71b8689a-d0d7-4288-b39e-5af56fc14b48 tempest-VolumesAdminNegativeTest-376871872 None] Acquiring lock "cinder-quobyte-2f48b0eb-f463-436e-9e39-3d83a353c682" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:38:33 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-71b8689a-d0d7-4288-b39e-5af56fc14b48 tempest-VolumesAdminNegativeTest-376871872 None] Lock "cinder-quobyte-2f48b0eb-f463-436e-9e39-3d83a353c682" acquired by "delete_volume" :: waited 0.021s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:38:33 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[9babcd8b-cbef-4dd3-baa2-209823cc186f]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:38:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-71b8689a-d0d7-4288-b39e-5af56fc14b48 tempest-VolumesAdminNegativeTest-376871872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2f48b0eb-f463-436e-9e39-3d83a353c682 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:33 devstack sudo[90824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82 Jul 17 19:38:33 devstack sudo[90824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:33 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2f48b0eb-f463-436e-9e39-3d83a353c682 Jul 17 19:38:33 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:33 devstack sudo[90824]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b12af381-f47e-4a93-85f3-c878fde0005f tempest-GroupSnapshotsTest-218644072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82" returned: 0 in 0.693s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b12af381-f47e-4a93-85f3-c878fde0005f tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82.787cc51f-25d1-4767-91b7-5734958cc3db {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:33 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82.787cc51f-25d1-4767-91b7-5734958cc3db Jul 17 19:38:33 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:33 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-71b8689a-d0d7-4288-b39e-5af56fc14b48 tempest-VolumesAdminNegativeTest-376871872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2f48b0eb-f463-436e-9e39-3d83a353c682" returned: 0 in 0.719s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-71b8689a-d0d7-4288-b39e-5af56fc14b48 tempest-VolumesAdminNegativeTest-376871872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2f48b0eb-f463-436e-9e39-3d83a353c682 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:33 devstack sudo[90839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2f48b0eb-f463-436e-9e39-3d83a353c682 Jul 17 19:38:33 devstack sudo[90839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:34 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b12af381-f47e-4a93-85f3-c878fde0005f tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82.787cc51f-25d1-4767-91b7-5734958cc3db" returned: 0 in 0.628s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b12af381-f47e-4a93-85f3-c878fde0005f tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82.787cc51f-25d1-4767-91b7-5734958cc3db {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:34 devstack sudo[90845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82.787cc51f-25d1-4767-91b7-5734958cc3db Jul 17 19:38:34 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:34 devstack sudo[90839]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-71b8689a-d0d7-4288-b39e-5af56fc14b48 tempest-VolumesAdminNegativeTest-376871872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2f48b0eb-f463-436e-9e39-3d83a353c682" returned: 0 in 0.557s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:34 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-71b8689a-d0d7-4288-b39e-5af56fc14b48 tempest-VolumesAdminNegativeTest-376871872 None] Lock "cinder-quobyte-2f48b0eb-f463-436e-9e39-3d83a353c682" released by "delete_volume" :: held 1.334s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:38:34 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-71b8689a-d0d7-4288-b39e-5af56fc14b48 tempest-VolumesAdminNegativeTest-376871872 None] Created reservations ['a34245a2-b0ec-4e8c-aff5-02b15bbe9e12', '5dfa340c-d9d3-4bdd-9eab-f38e6f5985ce', 'f917a3b7-966c-45c4-8c72-c5999ae862b2', 'ad41b834-bdc7-43be-86c5-a0936fffaaec'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:38:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-71b8689a-d0d7-4288-b39e-5af56fc14b48 tempest-VolumesAdminNegativeTest-376871872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:38:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-71b8689a-d0d7-4288-b39e-5af56fc14b48 tempest-VolumesAdminNegativeTest-376871872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:38:34 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-71b8689a-d0d7-4288-b39e-5af56fc14b48 tempest-VolumesAdminNegativeTest-376871872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:38:34 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-71b8689a-d0d7-4288-b39e-5af56fc14b48 tempest-VolumesAdminNegativeTest-376871872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:38:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-71b8689a-d0d7-4288-b39e-5af56fc14b48 tempest-VolumesAdminNegativeTest-376871872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:38:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-71b8689a-d0d7-4288-b39e-5af56fc14b48 tempest-VolumesAdminNegativeTest-376871872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:34 devstack sudo[90847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:38:34 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:34 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b12af381-f47e-4a93-85f3-c878fde0005f tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82.787cc51f-25d1-4767-91b7-5734958cc3db" returned: 0 in 0.611s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:35 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-b12af381-f47e-4a93-85f3-c878fde0005f tempest-GroupSnapshotsTest-218644072 None] Lock "cinder-quobyte-787cc51f-25d1-4767-91b7-5734958cc3db" released by "_delete_snapshot" :: held 2.727s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:38:35 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-b12af381-f47e-4a93-85f3-c878fde0005f tempest-GroupSnapshotsTest-218644072 None] Lock "cinder-quobyte-5815214f-7403-40e6-ba69-c585dbee7d82" released by "delete_snapshot" :: held 2.773s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:38:35 devstack cinder-volume[87726]: WARNING cinder.quota [None req-b12af381-f47e-4a93-85f3-c878fde0005f tempest-GroupSnapshotsTest-218644072 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-101313321 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-101313321, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:38:35 devstack cinder-volume[87726]: WARNING cinder.quota [None req-b12af381-f47e-4a93-85f3-c878fde0005f tempest-GroupSnapshotsTest-218644072 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-101313321 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-101313321, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:38:35 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-71b8689a-d0d7-4288-b39e-5af56fc14b48 tempest-VolumesAdminNegativeTest-376871872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.515s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:35 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-71b8689a-d0d7-4288-b39e-5af56fc14b48 tempest-VolumesAdminNegativeTest-376871872 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:38:35 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-71b8689a-d0d7-4288-b39e-5af56fc14b48 tempest-VolumesAdminNegativeTest-376871872 None] Deleted volume successfully. Jul 17 19:38:35 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-b12af381-f47e-4a93-85f3-c878fde0005f tempest-GroupSnapshotsTest-218644072 None] Created reservations ['b4e94df8-dfec-4653-8308-b0b251b3e585', 'fec4f874-67b7-4078-9f68-dc67aa7314c6', '1d128a46-47e1-4f99-ad8b-2b44b904547a', '3279b9d9-c420-4989-9cfe-e369fbbecf58'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:38:35 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-71b8689a-d0d7-4288-b39e-5af56fc14b48 tempest-VolumesAdminNegativeTest-376871872 None] Lock "cinder-2f48b0eb-f463-436e-9e39-3d83a353c682-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:38:35 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-b12af381-f47e-4a93-85f3-c878fde0005f tempest-GroupSnapshotsTest-218644072 None] group_snapshot 0190ee78-7bd5-45bd-8c3b-4c0f1d3dfe9c: deleted successfully Jul 17 19:38:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f8596079-b63f-4104-89cf-c316b0ff22f4 tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "cinder-quobyte-5815214f-7403-40e6-ba69-c585dbee7d82" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:38:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f8596079-b63f-4104-89cf-c316b0ff22f4 tempest-GroupSnapshotsTest-218644072 None] Lock "cinder-quobyte-5815214f-7403-40e6-ba69-c585dbee7d82" acquired by "delete_volume" :: waited 0.053s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:38:36 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ae18bb-d8fb-4186-93b2-254cc1ae0661]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:38:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f8596079-b63f-4104-89cf-c316b0ff22f4 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:36 devstack sudo[90872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82 Jul 17 19:38:36 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:37 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f8596079-b63f-4104-89cf-c316b0ff22f4 tempest-GroupSnapshotsTest-218644072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82" returned: 0 in 0.603s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f8596079-b63f-4104-89cf-c316b0ff22f4 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:37 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82 Jul 17 19:38:37 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:37 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f8596079-b63f-4104-89cf-c316b0ff22f4 tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5815214f-7403-40e6-ba69-c585dbee7d82" returned: 0 in 0.648s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:38 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f8596079-b63f-4104-89cf-c316b0ff22f4 tempest-GroupSnapshotsTest-218644072 None] Lock "cinder-quobyte-5815214f-7403-40e6-ba69-c585dbee7d82" released by "delete_volume" :: held 1.402s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:38:38 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-f8596079-b63f-4104-89cf-c316b0ff22f4 tempest-GroupSnapshotsTest-218644072 None] Created reservations ['06075ed4-d3e3-4018-835d-e104fbf17ef5'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:38:38 devstack cinder-volume[87726]: WARNING cinder.quota [None req-f8596079-b63f-4104-89cf-c316b0ff22f4 tempest-GroupSnapshotsTest-218644072 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-101313321 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-101313321, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:38:38 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-f8596079-b63f-4104-89cf-c316b0ff22f4 tempest-GroupSnapshotsTest-218644072 None] Created reservations ['7a9d9c9b-5ff0-4992-8032-185d778d1f88', '112aca72-805c-49d2-9d26-a1acf23a126b', '6e4ccbdd-6939-4f93-8015-ae46f3a0ba7f', '75a83c51-99d4-4e57-8278-4144e78c7751'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:38:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f8596079-b63f-4104-89cf-c316b0ff22f4 tempest-GroupSnapshotsTest-218644072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:38:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f8596079-b63f-4104-89cf-c316b0ff22f4 tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:38:38 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-f8596079-b63f-4104-89cf-c316b0ff22f4 tempest-GroupSnapshotsTest-218644072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:38:38 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-f8596079-b63f-4104-89cf-c316b0ff22f4 tempest-GroupSnapshotsTest-218644072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:38:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f8596079-b63f-4104-89cf-c316b0ff22f4 tempest-GroupSnapshotsTest-218644072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:38:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f8596079-b63f-4104-89cf-c316b0ff22f4 tempest-GroupSnapshotsTest-218644072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:38 devstack sudo[90890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:38:38 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:38 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f8596079-b63f-4104-89cf-c316b0ff22f4 tempest-GroupSnapshotsTest-218644072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.303s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:38 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-f8596079-b63f-4104-89cf-c316b0ff22f4 tempest-GroupSnapshotsTest-218644072 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:38:38 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-f8596079-b63f-4104-89cf-c316b0ff22f4 tempest-GroupSnapshotsTest-218644072 None] Delete group completed successfully. Jul 17 19:38:39 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-a09a4665-0e99-46da-9245-2aaee3a0457b req-2f93e268-10bc-448c-b3fa-b5aaab3edb8a tempest-ServerActionsTestOtherA-2088443176 None] Terminate volume connection completed successfully. Jul 17 19:38:39 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-a09a4665-0e99-46da-9245-2aaee3a0457b req-2f93e268-10bc-448c-b3fa-b5aaab3edb8a tempest-ServerActionsTestOtherA-2088443176 None] Deleting attachment 548004e9-6d75-4ffb-9379-b212c2d6c757. {{(pid=87726) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 19:38:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a1150d82-e4bf-4a27-aa12-bb7900e2372b tempest-ServerActionsTestOtherA-2088443176 None] Acquiring lock "cinder-5237f408-9530-4077-ada7-4cc2eda94a2f-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:38:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a1150d82-e4bf-4a27-aa12-bb7900e2372b tempest-ServerActionsTestOtherA-2088443176 None] Lock "cinder-5237f408-9530-4077-ada7-4cc2eda94a2f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:38:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a1150d82-e4bf-4a27-aa12-bb7900e2372b tempest-ServerActionsTestOtherA-2088443176 None] Acquiring lock "cinder-quobyte-5237f408-9530-4077-ada7-4cc2eda94a2f" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:38:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a1150d82-e4bf-4a27-aa12-bb7900e2372b tempest-ServerActionsTestOtherA-2088443176 None] Lock "cinder-quobyte-5237f408-9530-4077-ada7-4cc2eda94a2f" acquired by "delete_volume" :: waited 0.033s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:38:47 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5c5ad8-b65b-4b0b-9dc8-097a8c4d7698]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:38:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a1150d82-e4bf-4a27-aa12-bb7900e2372b tempest-ServerActionsTestOtherA-2088443176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5237f408-9530-4077-ada7-4cc2eda94a2f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:47 devstack sudo[90986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5237f408-9530-4077-ada7-4cc2eda94a2f Jul 17 19:38:47 devstack sudo[90986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:47 devstack sudo[90986]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a1150d82-e4bf-4a27-aa12-bb7900e2372b tempest-ServerActionsTestOtherA-2088443176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5237f408-9530-4077-ada7-4cc2eda94a2f" returned: 0 in 0.477s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a1150d82-e4bf-4a27-aa12-bb7900e2372b tempest-ServerActionsTestOtherA-2088443176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5237f408-9530-4077-ada7-4cc2eda94a2f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:47 devstack sudo[90993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5237f408-9530-4077-ada7-4cc2eda94a2f Jul 17 19:38:47 devstack sudo[90993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:48 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-b37dc810-f3ee-45c8-a53d-093874624aa6 tempest-GroupsTest-1367177831 None] Group tempest-Group1-658207773: creating Jul 17 19:38:48 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-b37dc810-f3ee-45c8-a53d-093874624aa6 tempest-GroupsTest-1367177831 None] Group tempest-Group1-658207773: created successfully Jul 17 19:38:48 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-b37dc810-f3ee-45c8-a53d-093874624aa6 tempest-GroupsTest-1367177831 None] Create group completed successfully. Jul 17 19:38:48 devstack sudo[90993]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a1150d82-e4bf-4a27-aa12-bb7900e2372b tempest-ServerActionsTestOtherA-2088443176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5237f408-9530-4077-ada7-4cc2eda94a2f" returned: 0 in 0.357s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:48 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a1150d82-e4bf-4a27-aa12-bb7900e2372b tempest-ServerActionsTestOtherA-2088443176 None] Lock "cinder-quobyte-5237f408-9530-4077-ada7-4cc2eda94a2f" released by "delete_volume" :: held 0.901s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:38:48 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-a1150d82-e4bf-4a27-aa12-bb7900e2372b tempest-ServerActionsTestOtherA-2088443176 None] Created reservations ['89057677-587f-46f8-852e-457e34dc9e4c', 'c4cd4889-cc0a-4116-9719-c92acc03b956', 'b557fc14-7966-4ea9-a5e3-0c6354792d8b', '422ca2ac-7957-4b51-99e5-22426fa28ce8'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:38:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a1150d82-e4bf-4a27-aa12-bb7900e2372b tempest-ServerActionsTestOtherA-2088443176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:38:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a1150d82-e4bf-4a27-aa12-bb7900e2372b tempest-ServerActionsTestOtherA-2088443176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:38:48 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a1150d82-e4bf-4a27-aa12-bb7900e2372b tempest-ServerActionsTestOtherA-2088443176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:38:48 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a1150d82-e4bf-4a27-aa12-bb7900e2372b tempest-ServerActionsTestOtherA-2088443176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:38:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a1150d82-e4bf-4a27-aa12-bb7900e2372b tempest-ServerActionsTestOtherA-2088443176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:38:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a1150d82-e4bf-4a27-aa12-bb7900e2372b tempest-ServerActionsTestOtherA-2088443176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:48 devstack sudo[90996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:38:48 devstack sudo[90996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:48 devstack sudo[90996]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a1150d82-e4bf-4a27-aa12-bb7900e2372b tempest-ServerActionsTestOtherA-2088443176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.276s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:48 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-a1150d82-e4bf-4a27-aa12-bb7900e2372b tempest-ServerActionsTestOtherA-2088443176 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:38:48 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-a1150d82-e4bf-4a27-aa12-bb7900e2372b tempest-ServerActionsTestOtherA-2088443176 None] Deleted volume successfully. Jul 17 19:38:48 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a1150d82-e4bf-4a27-aa12-bb7900e2372b tempest-ServerActionsTestOtherA-2088443176 None] Lock "cinder-5237f408-9530-4077-ada7-4cc2eda94a2f-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:38:49 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-61ba71c3-795e-4418-82e9-b403683a8d48 tempest-GroupsTest-1367177831 None] Group tempest-Group2-473426404: creating Jul 17 19:38:49 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-61ba71c3-795e-4418-82e9-b403683a8d48 tempest-GroupsTest-1367177831 None] Group tempest-Group2-473426404: created successfully Jul 17 19:38:49 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-61ba71c3-795e-4418-82e9-b403683a8d48 tempest-GroupsTest-1367177831 None] Create group completed successfully. Jul 17 19:38:51 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:38:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] Flow 'volume_create_manager' (ce0000be-9fa3-495e-97af-4f6ccd54fc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:38:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc9eefb9-e54c-4a9c-9066-b69b4d3290cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:38:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc9eefb9-e54c-4a9c-9066-b69b4d3290cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1655855274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=60c9452c-4bd2-4596-afd4-19a76a87543a,host='devstack@QuobyteHD#QuobyteHD',id=53aefb19-6475-49c3-a338-e4548231a380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7837546c56724acb8e67e6fe5ac942ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:38:51Z,use_quota=True,user_id='dbc0d4b4d47942a980a8ece7464128ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f1b1ab8-42f6-4388-be38-8f83f84b1272),volume_type_id=3f1b1ab8-42f6-4388-be38-8f83f84b1272)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:38:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abff2a0c-2033-48f2-9625-ffc3af884e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:38:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abff2a0c-2033-48f2-9625-ffc3af884e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:38:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f5aea5-2a9a-48cd-bd87-6561f2703897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:38:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f5aea5-2a9a-48cd-bd87-6561f2703897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53aefb19-6475-49c3-a338-e4548231a380', 'volume_name': 'volume-53aefb19-6475-49c3-a338-e4548231a380', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:38:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (705e1f42-d6ea-42b5-a140-75392fd316e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:38:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (705e1f42-d6ea-42b5-a140-75392fd316e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:38:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03d27c33-5feb-414e-94f8-817dfe30801e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:38:51 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] Volume 53aefb19-6475-49c3-a338-e4548231a380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53aefb19-6475-49c3-a338-e4548231a380', 'volume_size': 1} Jul 17 19:38:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:38:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:38:51 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=60c9452c-4bd2-4596-afd4-19a76a87543a,created_at=2026-07-17T17:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1655855274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=60c9452c-4bd2-4596-afd4-19a76a87543a,host='devstack@QuobyteHD#QuobyteHD',id=53aefb19-6475-49c3-a338-e4548231a380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7837546c56724acb8e67e6fe5ac942ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:38:51Z,use_quota=True,user_id='dbc0d4b4d47942a980a8ece7464128ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f1b1ab8-42f6-4388-be38-8f83f84b1272),volume_type_id=3f1b1ab8-42f6-4388-be38-8f83f84b1272)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:38:51 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] Creating volume 53aefb19-6475-49c3-a338-e4548231a380 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:38:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:38:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:38:51 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:38:51 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:38:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:38:51 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:38:51 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:38:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-53aefb19-6475-49c3-a338-e4548231a380 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:51 devstack sudo[91027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-53aefb19-6475-49c3-a338-e4548231a380 1073741824 Jul 17 19:38:51 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:51 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-53aefb19-6475-49c3-a338-e4548231a380 1073741824" returned: 0 in 0.505s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-53aefb19-6475-49c3-a338-e4548231a380 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:51 devstack sudo[91035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-53aefb19-6475-49c3-a338-e4548231a380 Jul 17 19:38:51 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:52 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-53aefb19-6475-49c3-a338-e4548231a380" returned: 0 in 0.257s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:52 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:38:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:38:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03d27c33-5feb-414e-94f8-817dfe30801e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53aefb19-6475-49c3-a338-e4548231a380', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:38:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f665d5b-9470-4758-8465-99e5f596d1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:38:52 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] Volume volume-53aefb19-6475-49c3-a338-e4548231a380 (53aefb19-6475-49c3-a338-e4548231a380): created successfully Jul 17 19:38:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f665d5b-9470-4758-8465-99e5f596d1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:38:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] Flow 'volume_create_manager' (ce0000be-9fa3-495e-97af-4f6ccd54fc11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:38:52 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-c7f52886-9a45-43aa-a763-40c71de13d48 tempest-GroupsTest-1367177831 None] Created volume successfully. Jul 17 19:38:53 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-33550c87-a099-4b6b-ba01-908694b18810 tempest-GroupsTest-1367177831 None] Acquiring lock "cinder-quobyte-53aefb19-6475-49c3-a338-e4548231a380" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:38:53 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-33550c87-a099-4b6b-ba01-908694b18810 tempest-GroupsTest-1367177831 None] Lock "cinder-quobyte-53aefb19-6475-49c3-a338-e4548231a380" acquired by "delete_volume" :: waited 0.019s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:38:53 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9a872b-6ea8-4ca9-8084-0348d17d65bb]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:38:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-33550c87-a099-4b6b-ba01-908694b18810 tempest-GroupsTest-1367177831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-53aefb19-6475-49c3-a338-e4548231a380 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:53 devstack sudo[91039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-53aefb19-6475-49c3-a338-e4548231a380 Jul 17 19:38:53 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:53 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-33550c87-a099-4b6b-ba01-908694b18810 tempest-GroupsTest-1367177831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-53aefb19-6475-49c3-a338-e4548231a380" returned: 0 in 0.455s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-33550c87-a099-4b6b-ba01-908694b18810 tempest-GroupsTest-1367177831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-53aefb19-6475-49c3-a338-e4548231a380 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:53 devstack sudo[91046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-53aefb19-6475-49c3-a338-e4548231a380 Jul 17 19:38:53 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:53 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-33550c87-a099-4b6b-ba01-908694b18810 tempest-GroupsTest-1367177831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-53aefb19-6475-49c3-a338-e4548231a380" returned: 0 in 0.290s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:53 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-33550c87-a099-4b6b-ba01-908694b18810 tempest-GroupsTest-1367177831 None] Lock "cinder-quobyte-53aefb19-6475-49c3-a338-e4548231a380" released by "delete_volume" :: held 0.815s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:38:54 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-33550c87-a099-4b6b-ba01-908694b18810 tempest-GroupsTest-1367177831 None] Created reservations ['80caa785-f4e1-4ae3-af28-385f03112d38'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:38:54 devstack cinder-volume[87726]: WARNING cinder.quota [None req-33550c87-a099-4b6b-ba01-908694b18810 tempest-GroupsTest-1367177831 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-604549085 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-604549085, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:38:54 devstack cinder-volume[87726]: WARNING cinder.quota [None req-33550c87-a099-4b6b-ba01-908694b18810 tempest-GroupsTest-1367177831 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-604549085 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-604549085, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:38:54 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-33550c87-a099-4b6b-ba01-908694b18810 tempest-GroupsTest-1367177831 None] Created reservations ['f27fba44-8135-4d80-9306-f1f2fe609f16', '439525fc-82c2-4066-916c-c4f87addb67f', '1487cf8e-2eb0-4dda-add1-bd9e94b611fb', '56511f4b-1205-403c-84a0-3500ab1ddc85'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:38:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-33550c87-a099-4b6b-ba01-908694b18810 tempest-GroupsTest-1367177831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:38:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-33550c87-a099-4b6b-ba01-908694b18810 tempest-GroupsTest-1367177831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:38:54 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-33550c87-a099-4b6b-ba01-908694b18810 tempest-GroupsTest-1367177831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:38:54 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-33550c87-a099-4b6b-ba01-908694b18810 tempest-GroupsTest-1367177831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:38:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-33550c87-a099-4b6b-ba01-908694b18810 tempest-GroupsTest-1367177831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:38:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-33550c87-a099-4b6b-ba01-908694b18810 tempest-GroupsTest-1367177831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:54 devstack sudo[91050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:38:54 devstack sudo[91050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:54 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-22458b24-7a54-43f2-a413-d212403355ab tempest-GroupsTest-1367177831 None] Created reservations ['44a8fa0d-021b-4d91-82d3-a0a77cf40b99'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:38:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-22458b24-7a54-43f2-a413-d212403355ab tempest-GroupsTest-1367177831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:38:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-22458b24-7a54-43f2-a413-d212403355ab tempest-GroupsTest-1367177831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:38:54 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-22458b24-7a54-43f2-a413-d212403355ab tempest-GroupsTest-1367177831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:38:54 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-22458b24-7a54-43f2-a413-d212403355ab tempest-GroupsTest-1367177831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:38:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-22458b24-7a54-43f2-a413-d212403355ab tempest-GroupsTest-1367177831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:38:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-22458b24-7a54-43f2-a413-d212403355ab tempest-GroupsTest-1367177831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:54 devstack sudo[91058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:38:54 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:54 devstack sudo[91050]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-33550c87-a099-4b6b-ba01-908694b18810 tempest-GroupsTest-1367177831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.564s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:54 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-33550c87-a099-4b6b-ba01-908694b18810 tempest-GroupsTest-1367177831 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:38:54 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-33550c87-a099-4b6b-ba01-908694b18810 tempest-GroupsTest-1367177831 None] Delete group completed successfully. Jul 17 19:38:55 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-22458b24-7a54-43f2-a413-d212403355ab tempest-GroupsTest-1367177831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.341s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:55 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-22458b24-7a54-43f2-a413-d212403355ab tempest-GroupsTest-1367177831 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:38:55 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-22458b24-7a54-43f2-a413-d212403355ab tempest-GroupsTest-1367177831 None] Delete group completed successfully. Jul 17 19:38:56 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e874b60a-1420-4cce-9c12-db250499ef45 tempest-GroupsTest-1367177831 None] Group tempest-GroupsTest-Group-1591218469: creating Jul 17 19:38:56 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e874b60a-1420-4cce-9c12-db250499ef45 tempest-GroupsTest-1367177831 None] Group tempest-GroupsTest-Group-1591218469: created successfully Jul 17 19:38:56 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e874b60a-1420-4cce-9c12-db250499ef45 tempest-GroupsTest-1367177831 None] Create group completed successfully. Jul 17 19:38:58 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:38:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] Flow 'volume_create_manager' (a3d36d13-00ba-4851-a226-ec3916bdf49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:38:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bff6219-8aa8-4080-b938-c877c4365291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:38:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bff6219-8aa8-4080-b938-c877c4365291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1704522791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dd69b032-d28a-4b45-a3bf-036c29212f29,host='devstack@QuobyteHD#QuobyteHD',id=c865bd8e-43e7-4328-a6cd-c236725e21c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7837546c56724acb8e67e6fe5ac942ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:38:58Z,use_quota=True,user_id='dbc0d4b4d47942a980a8ece7464128ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccdb556d-889a-4f23-8255-bf2ce9f08b50),volume_type_id=ccdb556d-889a-4f23-8255-bf2ce9f08b50)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:38:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e85d542-01ed-469e-94ab-0a6fd2ed1eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:38:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e85d542-01ed-469e-94ab-0a6fd2ed1eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:38:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad9a6c0-6232-4bbb-8914-98d414e416bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:38:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad9a6c0-6232-4bbb-8914-98d414e416bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c865bd8e-43e7-4328-a6cd-c236725e21c6', 'volume_name': 'volume-c865bd8e-43e7-4328-a6cd-c236725e21c6', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:38:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3bee939-1bb1-410d-98df-a32660ff1be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:38:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3bee939-1bb1-410d-98df-a32660ff1be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:38:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abd1855d-6f1d-42f7-b56c-d2fafbb9d569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:38:58 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] Volume c865bd8e-43e7-4328-a6cd-c236725e21c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c865bd8e-43e7-4328-a6cd-c236725e21c6', 'volume_size': 1} Jul 17 19:38:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:38:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:38:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dd69b032-d28a-4b45-a3bf-036c29212f29,created_at=2026-07-17T17:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1704522791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dd69b032-d28a-4b45-a3bf-036c29212f29,host='devstack@QuobyteHD#QuobyteHD',id=c865bd8e-43e7-4328-a6cd-c236725e21c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7837546c56724acb8e67e6fe5ac942ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:38:58Z,use_quota=True,user_id='dbc0d4b4d47942a980a8ece7464128ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccdb556d-889a-4f23-8255-bf2ce9f08b50),volume_type_id=ccdb556d-889a-4f23-8255-bf2ce9f08b50)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:38:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] Creating volume c865bd8e-43e7-4328-a6cd-c236725e21c6 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:38:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:38:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:38:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:38:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:38:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:38:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:38:58 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:38:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c865bd8e-43e7-4328-a6cd-c236725e21c6 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:58 devstack sudo[91067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c865bd8e-43e7-4328-a6cd-c236725e21c6 1073741824 Jul 17 19:38:58 devstack sudo[91067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:58 devstack sudo[91067]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c865bd8e-43e7-4328-a6cd-c236725e21c6 1073741824" returned: 0 in 0.588s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c865bd8e-43e7-4328-a6cd-c236725e21c6 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:38:58 devstack sudo[91075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c865bd8e-43e7-4328-a6cd-c236725e21c6 Jul 17 19:38:58 devstack sudo[91075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:38:59 devstack sudo[91075]: pam_unix(sudo:session): session closed for user root Jul 17 19:38:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c865bd8e-43e7-4328-a6cd-c236725e21c6" returned: 0 in 0.316s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:38:59 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:38:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:38:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abd1855d-6f1d-42f7-b56c-d2fafbb9d569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c865bd8e-43e7-4328-a6cd-c236725e21c6', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:38:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4b71c93-8709-42ac-ac7b-76a1c9e20e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:38:59 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] Volume volume-c865bd8e-43e7-4328-a6cd-c236725e21c6 (c865bd8e-43e7-4328-a6cd-c236725e21c6): created successfully Jul 17 19:38:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4b71c93-8709-42ac-ac7b-76a1c9e20e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:38:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] Flow 'volume_create_manager' (a3d36d13-00ba-4851-a226-ec3916bdf49d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:38:59 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-d425a215-0ca5-46f1-a480-ab7befe231ba tempest-GroupsTest-1367177831 None] Created volume successfully. Jul 17 19:39:01 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:39:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] Flow 'volume_create_manager' (0b08178a-224f-496f-b459-e7dfff93f4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:39:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d958b95f-e835-4387-8a59-c2fb45326fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:39:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d958b95f-e835-4387-8a59-c2fb45326fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-866983919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dd69b032-d28a-4b45-a3bf-036c29212f29,host='devstack@QuobyteHD#QuobyteHD',id=26b59071-1521-4826-b97a-72cae97850d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7837546c56724acb8e67e6fe5ac942ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:39:01Z,use_quota=True,user_id='dbc0d4b4d47942a980a8ece7464128ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccdb556d-889a-4f23-8255-bf2ce9f08b50),volume_type_id=ccdb556d-889a-4f23-8255-bf2ce9f08b50)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:39:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0abf6ce6-18f8-4fb0-bd73-f92d0d140b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:39:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0abf6ce6-18f8-4fb0-bd73-f92d0d140b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:39:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (662d75ab-3352-424e-820d-6c36a6408ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:39:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (662d75ab-3352-424e-820d-6c36a6408ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26b59071-1521-4826-b97a-72cae97850d3', 'volume_name': 'volume-26b59071-1521-4826-b97a-72cae97850d3', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:39:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7cf7f7e-b84d-47df-aca8-5776071a729c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:39:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7cf7f7e-b84d-47df-aca8-5776071a729c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:39:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4110c3a5-a484-4642-a63e-3227913a6408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:39:01 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] Volume 26b59071-1521-4826-b97a-72cae97850d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26b59071-1521-4826-b97a-72cae97850d3', 'volume_size': 1} Jul 17 19:39:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:39:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:39:01 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dd69b032-d28a-4b45-a3bf-036c29212f29,created_at=2026-07-17T17:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-866983919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dd69b032-d28a-4b45-a3bf-036c29212f29,host='devstack@QuobyteHD#QuobyteHD',id=26b59071-1521-4826-b97a-72cae97850d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7837546c56724acb8e67e6fe5ac942ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:39:01Z,use_quota=True,user_id='dbc0d4b4d47942a980a8ece7464128ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccdb556d-889a-4f23-8255-bf2ce9f08b50),volume_type_id=ccdb556d-889a-4f23-8255-bf2ce9f08b50)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:39:01 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] Creating volume 26b59071-1521-4826-b97a-72cae97850d3 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:39:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:39:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:39:01 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:39:01 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:39:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:39:01 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:39:01 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:39:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-26b59071-1521-4826-b97a-72cae97850d3 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:39:01 devstack sudo[91079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-26b59071-1521-4826-b97a-72cae97850d3 1073741824 Jul 17 19:39:01 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:39:01 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root Jul 17 19:39:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-26b59071-1521-4826-b97a-72cae97850d3 1073741824" returned: 0 in 0.548s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:39:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-26b59071-1521-4826-b97a-72cae97850d3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:39:01 devstack sudo[91085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-26b59071-1521-4826-b97a-72cae97850d3 Jul 17 19:39:01 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:39:02 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root Jul 17 19:39:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-26b59071-1521-4826-b97a-72cae97850d3" returned: 0 in 0.279s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:39:02 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:39:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:39:02 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4110c3a5-a484-4642-a63e-3227913a6408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26b59071-1521-4826-b97a-72cae97850d3', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:39:02 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cfcd284-ef2b-411e-ad16-8b7a06039eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:39:02 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] Volume volume-26b59071-1521-4826-b97a-72cae97850d3 (26b59071-1521-4826-b97a-72cae97850d3): created successfully Jul 17 19:39:02 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cfcd284-ef2b-411e-ad16-8b7a06039eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:39:02 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] Flow 'volume_create_manager' (0b08178a-224f-496f-b459-e7dfff93f4d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:39:02 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:UPDATE=103,cinder:SELECT=102,cinder:INSERT=28,cinder:DELETE=3 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:39:02 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-d1a751d4-7e52-4b64-8b60-01b20b4126e4 tempest-GroupsTest-1367177831 None] Created volume successfully. Jul 17 19:39:02 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-c9a417dc-74d6-48bb-9b26-0451139bdb31 tempest-GroupsTest-1367177831 None] Update group completed successfully. Jul 17 19:39:03 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=111,cinder:UPDATE=112,cinder:INSERT=21,cinder:DELETE=5 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:39:04 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-983f1ca3-7a54-4a41-b1da-66693bac3c81 tempest-GroupsTest-1367177831 None] Update group completed successfully. Jul 17 19:39:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-59c66684-e00b-411a-85fa-30e8faefe3cd tempest-GroupsTest-1367177831 None] Acquiring lock "cinder-quobyte-26b59071-1521-4826-b97a-72cae97850d3" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:39:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-59c66684-e00b-411a-85fa-30e8faefe3cd tempest-GroupsTest-1367177831 None] Lock "cinder-quobyte-26b59071-1521-4826-b97a-72cae97850d3" acquired by "delete_volume" :: waited 0.048s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:39:05 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4c59e5-5b94-4237-bb5b-6d64de51aa34]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:39:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-59c66684-e00b-411a-85fa-30e8faefe3cd tempest-GroupsTest-1367177831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-26b59071-1521-4826-b97a-72cae97850d3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:39:06 devstack sudo[91091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-26b59071-1521-4826-b97a-72cae97850d3 Jul 17 19:39:06 devstack sudo[91091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:39:06 devstack sudo[91091]: pam_unix(sudo:session): session closed for user root Jul 17 19:39:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-59c66684-e00b-411a-85fa-30e8faefe3cd tempest-GroupsTest-1367177831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-26b59071-1521-4826-b97a-72cae97850d3" returned: 0 in 0.509s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:39:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-59c66684-e00b-411a-85fa-30e8faefe3cd tempest-GroupsTest-1367177831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-26b59071-1521-4826-b97a-72cae97850d3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:39:06 devstack sudo[91096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-26b59071-1521-4826-b97a-72cae97850d3 Jul 17 19:39:06 devstack sudo[91096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:39:06 devstack sudo[91096]: pam_unix(sudo:session): session closed for user root Jul 17 19:39:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-59c66684-e00b-411a-85fa-30e8faefe3cd tempest-GroupsTest-1367177831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-26b59071-1521-4826-b97a-72cae97850d3" returned: 0 in 0.281s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:39:06 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-59c66684-e00b-411a-85fa-30e8faefe3cd tempest-GroupsTest-1367177831 None] Lock "cinder-quobyte-26b59071-1521-4826-b97a-72cae97850d3" released by "delete_volume" :: held 0.868s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:39:06 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-59c66684-e00b-411a-85fa-30e8faefe3cd tempest-GroupsTest-1367177831 None] Acquiring lock "cinder-quobyte-c865bd8e-43e7-4328-a6cd-c236725e21c6" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:39:06 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-59c66684-e00b-411a-85fa-30e8faefe3cd tempest-GroupsTest-1367177831 None] Lock "cinder-quobyte-c865bd8e-43e7-4328-a6cd-c236725e21c6" acquired by "delete_volume" :: waited 0.022s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:39:06 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8cb61a-94b7-4d0f-b5b4-a1e4bdc32a9c]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:39:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-59c66684-e00b-411a-85fa-30e8faefe3cd tempest-GroupsTest-1367177831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c865bd8e-43e7-4328-a6cd-c236725e21c6 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:39:06 devstack sudo[91099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c865bd8e-43e7-4328-a6cd-c236725e21c6 Jul 17 19:39:06 devstack sudo[91099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:39:07 devstack sudo[91099]: pam_unix(sudo:session): session closed for user root Jul 17 19:39:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-59c66684-e00b-411a-85fa-30e8faefe3cd tempest-GroupsTest-1367177831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c865bd8e-43e7-4328-a6cd-c236725e21c6" returned: 0 in 0.435s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:39:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-59c66684-e00b-411a-85fa-30e8faefe3cd tempest-GroupsTest-1367177831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c865bd8e-43e7-4328-a6cd-c236725e21c6 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:39:07 devstack sudo[91104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c865bd8e-43e7-4328-a6cd-c236725e21c6 Jul 17 19:39:07 devstack sudo[91104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:39:07 devstack sudo[91104]: pam_unix(sudo:session): session closed for user root Jul 17 19:39:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-59c66684-e00b-411a-85fa-30e8faefe3cd tempest-GroupsTest-1367177831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c865bd8e-43e7-4328-a6cd-c236725e21c6" returned: 0 in 0.324s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:39:07 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-59c66684-e00b-411a-85fa-30e8faefe3cd tempest-GroupsTest-1367177831 None] Lock "cinder-quobyte-c865bd8e-43e7-4328-a6cd-c236725e21c6" released by "delete_volume" :: held 0.828s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:39:07 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-59c66684-e00b-411a-85fa-30e8faefe3cd tempest-GroupsTest-1367177831 None] Created reservations ['4acbb229-9f3d-4b77-9a27-748ffabbb1f7'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:39:07 devstack cinder-volume[87726]: WARNING cinder.quota [None req-59c66684-e00b-411a-85fa-30e8faefe3cd tempest-GroupsTest-1367177831 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1435484774 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1435484774, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:39:07 devstack cinder-volume[87726]: WARNING cinder.quota [None req-59c66684-e00b-411a-85fa-30e8faefe3cd tempest-GroupsTest-1367177831 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1435484774 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1435484774, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:39:07 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-59c66684-e00b-411a-85fa-30e8faefe3cd tempest-GroupsTest-1367177831 None] Created reservations ['86713085-ea06-4f95-9615-9e99bef11e8c', 'aa7bfc4d-8603-4bac-8ed9-dafef8fe0c86', '6e5d8552-4ebc-48b7-b25d-67403acb63bf', '305664ef-63a4-4dd6-982a-f56867462c52'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:39:07 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-59c66684-e00b-411a-85fa-30e8faefe3cd tempest-GroupsTest-1367177831 None] Created reservations ['1cdda213-f0dc-443a-80e5-fee5982ff026', '99a8b874-3a03-434d-8b56-b6fe9091ea21', 'd95b35a4-7def-418c-9d36-c9c3cfacdc5a', '9438ef5b-e565-46c9-8ddc-16e7767d6dab'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:39:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-59c66684-e00b-411a-85fa-30e8faefe3cd tempest-GroupsTest-1367177831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:39:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-59c66684-e00b-411a-85fa-30e8faefe3cd tempest-GroupsTest-1367177831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:39:07 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-59c66684-e00b-411a-85fa-30e8faefe3cd tempest-GroupsTest-1367177831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:39:07 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-59c66684-e00b-411a-85fa-30e8faefe3cd tempest-GroupsTest-1367177831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:39:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-59c66684-e00b-411a-85fa-30e8faefe3cd tempest-GroupsTest-1367177831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:39:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-59c66684-e00b-411a-85fa-30e8faefe3cd tempest-GroupsTest-1367177831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:39:08 devstack sudo[91108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:39:08 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:39:08 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root Jul 17 19:39:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-59c66684-e00b-411a-85fa-30e8faefe3cd tempest-GroupsTest-1367177831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.334s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:39:08 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-59c66684-e00b-411a-85fa-30e8faefe3cd tempest-GroupsTest-1367177831 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:39:08 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-59c66684-e00b-411a-85fa-30e8faefe3cd tempest-GroupsTest-1367177831 None] Delete group completed successfully. Jul 17 19:39:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:39:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:39:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:39:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:39:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:39:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:39:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:39:15 devstack sudo[91172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:39:15 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:39:15 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root Jul 17 19:39:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.535s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:39:15 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:39:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager._thread_info {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:39:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread count: 8 {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 19:39:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread info: [<_MainThread(MainThread, started 130066227544192)>, , , , , , , ] {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 19:39:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-75218627-4ac6-4165-a81b-b8493ac38d87 req-18dfca71-60c9-4dcf-b04f-1f2b428a378b tempest-TaggedAttachmentsTest-887101203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:39:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-75218627-4ac6-4165-a81b-b8493ac38d87 req-18dfca71-60c9-4dcf-b04f-1f2b428a378b tempest-TaggedAttachmentsTest-887101203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:39:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-75218627-4ac6-4165-a81b-b8493ac38d87 req-18dfca71-60c9-4dcf-b04f-1f2b428a378b tempest-TaggedAttachmentsTest-887101203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:39:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-75218627-4ac6-4165-a81b-b8493ac38d87 req-18dfca71-60c9-4dcf-b04f-1f2b428a378b tempest-TaggedAttachmentsTest-887101203 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55', 'name': 'volume-9b3e0663-8da6-42ef-aa25-b77fb3c15c15', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bba86593-9f84-4223-ad6f-be25176e1573', 'enforce_multipath': True} {{(pid=87726) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 19:39:17 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-75218627-4ac6-4165-a81b-b8493ac38d87 req-18dfca71-60c9-4dcf-b04f-1f2b428a378b tempest-TaggedAttachmentsTest-887101203 None] attachment_update completed successfully. Jul 17 19:39:21 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-f74cd3e3-1511-4be2-992a-892d5a27b44a req-fd6ea963-a014-4d98-9752-24b1c6c294a8 tempest-TaggedAttachmentsTest-887101203 None] Terminate volume connection completed successfully. Jul 17 19:39:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-f74cd3e3-1511-4be2-992a-892d5a27b44a req-fd6ea963-a014-4d98-9752-24b1c6c294a8 tempest-TaggedAttachmentsTest-887101203 None] Deleting attachment bba86593-9f84-4223-ad6f-be25176e1573. {{(pid=87726) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 19:39:31 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=27,cinder:UPDATE=24,cinder:INSERT=4 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:39:31 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:UPDATE=19,cinder:SELECT=18,cinder:INSERT=5 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:39:36 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:39:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Flow 'volume_create_manager' (a5956086-3238-4134-bd98-6de939ad0528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:39:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e4845d6-e835-4ad8-828b-70625331e2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:39:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e4845d6-e835-4ad8-828b-70625331e2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-883060465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9550096d-18d9-4dfa-a790-d3a576b14bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a9466c03b5347ef84a8944a165ab4bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:39:37Z,use_quota=True,user_id='8118171ef0a1416895c0589e129c0fde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:39:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d52eb3-ad39-46ea-88bf-111b49d36718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:39:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d52eb3-ad39-46ea-88bf-111b49d36718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:39:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5800b25b-b2b8-494c-9554-d9eae4a96ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:39:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5800b25b-b2b8-494c-9554-d9eae4a96ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9550096d-18d9-4dfa-a790-d3a576b14bf1', 'volume_name': 'volume-9550096d-18d9-4dfa-a790-d3a576b14bf1', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:39:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4144265d-5876-45cf-ae03-5e63e7d8975d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:39:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4144265d-5876-45cf-ae03-5e63e7d8975d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:39:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80008e0a-3861-43ca-bd49-20f2b02a039a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:39:36 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Volume 9550096d-18d9-4dfa-a790-d3a576b14bf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9550096d-18d9-4dfa-a790-d3a576b14bf1', 'volume_size': 1} Jul 17 19:39:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:39:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:39:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-883060465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9550096d-18d9-4dfa-a790-d3a576b14bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a9466c03b5347ef84a8944a165ab4bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:39:37Z,use_quota=True,user_id='8118171ef0a1416895c0589e129c0fde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:39:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Creating volume 9550096d-18d9-4dfa-a790-d3a576b14bf1 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:39:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:39:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:39:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:39:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:39:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:39:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:39:37 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:39:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:39:37 devstack sudo[91907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1 1073741824 Jul 17 19:39:37 devstack sudo[91907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:39:38 devstack sudo[91907]: pam_unix(sudo:session): session closed for user root Jul 17 19:39:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1 1073741824" returned: 0 in 1.047s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:39:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:39:38 devstack sudo[91917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1 Jul 17 19:39:38 devstack sudo[91917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:39:39 devstack sudo[91917]: pam_unix(sudo:session): session closed for user root Jul 17 19:39:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1" returned: 0 in 0.866s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:39:39 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] <== create_volume: return (2088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:39:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.105s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:39:39 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80008e0a-3861-43ca-bd49-20f2b02a039a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9550096d-18d9-4dfa-a790-d3a576b14bf1', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:39:39 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a1c0556-8922-4d1e-827e-95bc2bf5738a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:39:39 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Volume volume-9550096d-18d9-4dfa-a790-d3a576b14bf1 (9550096d-18d9-4dfa-a790-d3a576b14bf1): created successfully Jul 17 19:39:39 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a1c0556-8922-4d1e-827e-95bc2bf5738a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:39:39 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Flow 'volume_create_manager' (a5956086-3238-4134-bd98-6de939ad0528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:39:39 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-b32c2aa6-adc6-4405-b351-78b5ab1afbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Created volume successfully. Jul 17 19:39:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-62042f11-6672-4a68-bb87-1e7288e39eb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:39:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-62042f11-6672-4a68-bb87-1e7288e39eb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:39:40 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-62042f11-6672-4a68-bb87-1e7288e39eb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Creating offline snapshot f7b37279-492e-49c4-8f5d-2e145313eb97 of volume 9550096d-18d9-4dfa-a790-d3a576b14bf1 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:39:40 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcd937c-a89b-4e4b-b8a5-0883f01f5aa0]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:39:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-62042f11-6672-4a68-bb87-1e7288e39eb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:39:40 devstack sudo[91987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1 Jul 17 19:39:40 devstack sudo[91987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:39:41 devstack sudo[91987]: pam_unix(sudo:session): session closed for user root Jul 17 19:39:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-62042f11-6672-4a68-bb87-1e7288e39eb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1" returned: 0 in 0.721s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:39:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-62042f11-6672-4a68-bb87-1e7288e39eb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1.f7b37279-492e-49c4-8f5d-2e145313eb97 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:39:41 devstack sudo[92003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1.f7b37279-492e-49c4-8f5d-2e145313eb97 1G Jul 17 19:39:41 devstack sudo[92003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:39:42 devstack sudo[92003]: pam_unix(sudo:session): session closed for user root Jul 17 19:39:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-62042f11-6672-4a68-bb87-1e7288e39eb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1.f7b37279-492e-49c4-8f5d-2e145313eb97 1G" returned: 0 in 0.863s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:39:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-62042f11-6672-4a68-bb87-1e7288e39eb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9550096d-18d9-4dfa-a790-d3a576b14bf1 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1.f7b37279-492e-49c4-8f5d-2e145313eb97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:39:42 devstack sudo[92044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9550096d-18d9-4dfa-a790-d3a576b14bf1 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1.f7b37279-492e-49c4-8f5d-2e145313eb97 Jul 17 19:39:42 devstack sudo[92044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:39:42 devstack sudo[92044]: pam_unix(sudo:session): session closed for user root Jul 17 19:39:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-62042f11-6672-4a68-bb87-1e7288e39eb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9550096d-18d9-4dfa-a790-d3a576b14bf1 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1.f7b37279-492e-49c4-8f5d-2e145313eb97" returned: 0 in 0.737s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:39:42 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-62042f11-6672-4a68-bb87-1e7288e39eb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1.f7b37279-492e-49c4-8f5d-2e145313eb97 is being set with open permissions: ugo+rw Jul 17 19:39:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-62042f11-6672-4a68-bb87-1e7288e39eb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1.f7b37279-492e-49c4-8f5d-2e145313eb97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:39:42 devstack sudo[92052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1.f7b37279-492e-49c4-8f5d-2e145313eb97 Jul 17 19:39:42 devstack sudo[92052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:39:43 devstack sudo[92052]: pam_unix(sudo:session): session closed for user root Jul 17 19:39:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-62042f11-6672-4a68-bb87-1e7288e39eb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1.f7b37279-492e-49c4-8f5d-2e145313eb97" returned: 0 in 0.314s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:39:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-62042f11-6672-4a68-bb87-1e7288e39eb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:39:43 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5ab35027-480b-4707-bded-8bff79ca7493 tempest-TaggedAttachmentsTest-887101203 None] Acquiring lock "cinder-9b3e0663-8da6-42ef-aa25-b77fb3c15c15-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:39:43 devstack sudo[92055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1.info Jul 17 19:39:43 devstack sudo[92055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:39:43 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5ab35027-480b-4707-bded-8bff79ca7493 tempest-TaggedAttachmentsTest-887101203 None] Lock "cinder-9b3e0663-8da6-42ef-aa25-b77fb3c15c15-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:39:43 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5ab35027-480b-4707-bded-8bff79ca7493 tempest-TaggedAttachmentsTest-887101203 None] Acquiring lock "cinder-quobyte-9b3e0663-8da6-42ef-aa25-b77fb3c15c15" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:39:43 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5ab35027-480b-4707-bded-8bff79ca7493 tempest-TaggedAttachmentsTest-887101203 None] Lock "cinder-quobyte-9b3e0663-8da6-42ef-aa25-b77fb3c15c15" acquired by "delete_volume" :: waited 0.036s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:39:43 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a33e52-5f17-42cc-ae8d-f3b335873209]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:39:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5ab35027-480b-4707-bded-8bff79ca7493 tempest-TaggedAttachmentsTest-887101203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9b3e0663-8da6-42ef-aa25-b77fb3c15c15 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:39:43 devstack sudo[92055]: pam_unix(sudo:session): session closed for user root Jul 17 19:39:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-62042f11-6672-4a68-bb87-1e7288e39eb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1.info" returned: 0 in 0.453s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:39:43 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-62042f11-6672-4a68-bb87-1e7288e39eb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1.info is being set with open permissions: ugo+rw Jul 17 19:39:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-62042f11-6672-4a68-bb87-1e7288e39eb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:39:43 devstack sudo[92059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1.info Jul 17 19:39:43 devstack sudo[92059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:39:43 devstack sudo[92057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9b3e0663-8da6-42ef-aa25-b77fb3c15c15 Jul 17 19:39:43 devstack sudo[92057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:39:44 devstack sudo[92057]: pam_unix(sudo:session): session closed for user root Jul 17 19:39:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5ab35027-480b-4707-bded-8bff79ca7493 tempest-TaggedAttachmentsTest-887101203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9b3e0663-8da6-42ef-aa25-b77fb3c15c15" returned: 0 in 0.606s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:39:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5ab35027-480b-4707-bded-8bff79ca7493 tempest-TaggedAttachmentsTest-887101203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9b3e0663-8da6-42ef-aa25-b77fb3c15c15 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:39:44 devstack sudo[92065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9b3e0663-8da6-42ef-aa25-b77fb3c15c15 Jul 17 19:39:44 devstack sudo[92065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:39:44 devstack sudo[92059]: pam_unix(sudo:session): session closed for user root Jul 17 19:39:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-62042f11-6672-4a68-bb87-1e7288e39eb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1.info" returned: 0 in 0.656s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:39:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-62042f11-6672-4a68-bb87-1e7288e39eb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.950s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:39:44 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-62042f11-6672-4a68-bb87-1e7288e39eb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Create snapshot completed successfully Jul 17 19:39:44 devstack sudo[92065]: pam_unix(sudo:session): session closed for user root Jul 17 19:39:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5ab35027-480b-4707-bded-8bff79ca7493 tempest-TaggedAttachmentsTest-887101203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9b3e0663-8da6-42ef-aa25-b77fb3c15c15" returned: 0 in 0.360s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:39:44 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5ab35027-480b-4707-bded-8bff79ca7493 tempest-TaggedAttachmentsTest-887101203 None] Lock "cinder-quobyte-9b3e0663-8da6-42ef-aa25-b77fb3c15c15" released by "delete_volume" :: held 1.063s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:39:44 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-5ab35027-480b-4707-bded-8bff79ca7493 tempest-TaggedAttachmentsTest-887101203 None] Created reservations ['3c54ad59-078e-4d2e-8b49-244be2fbb408', '42e47344-002a-4f2f-a3ac-c23219fc1ae4', '86b17298-01b2-4495-b13e-93dcb1e44d08', '936ce0bd-0626-45d5-b310-04f5109a18c8'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:39:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5ab35027-480b-4707-bded-8bff79ca7493 tempest-TaggedAttachmentsTest-887101203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:39:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5ab35027-480b-4707-bded-8bff79ca7493 tempest-TaggedAttachmentsTest-887101203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:39:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5ab35027-480b-4707-bded-8bff79ca7493 tempest-TaggedAttachmentsTest-887101203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:39:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5ab35027-480b-4707-bded-8bff79ca7493 tempest-TaggedAttachmentsTest-887101203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:39:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5ab35027-480b-4707-bded-8bff79ca7493 tempest-TaggedAttachmentsTest-887101203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:39:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5ab35027-480b-4707-bded-8bff79ca7493 tempest-TaggedAttachmentsTest-887101203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:39:44 devstack sudo[92069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:39:45 devstack sudo[92069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:39:45 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:39:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] Flow 'volume_create_manager' (03bede44-583a-4f43-b59b-eca6528d889e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:39:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16afb497-7905-43af-8834-cc1fd956e2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:39:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16afb497-7905-43af-8834-cc1fd956e2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1589870522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc51d3d4-9d0c-42e1-9c6e-afcbcfb27378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f46be6da70a41ceab78a2b8d617b191',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:39:45Z,use_quota=True,user_id='ac7a2ba516d9459d8103f2d46619dcdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:39:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f73bcf-0dce-46af-a1a2-6e1dbbc51560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:39:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f73bcf-0dce-46af-a1a2-6e1dbbc51560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:39:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6c555e3-90f0-4bb9-bdca-171f32ad07f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:39:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6c555e3-90f0-4bb9-bdca-171f32ad07f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc51d3d4-9d0c-42e1-9c6e-afcbcfb27378', 'volume_name': 'volume-bc51d3d4-9d0c-42e1-9c6e-afcbcfb27378', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:39:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20f7c4cd-c5f3-46cb-a14a-9589c775321a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:39:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20f7c4cd-c5f3-46cb-a14a-9589c775321a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:39:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66790be1-8a22-4977-a313-4a998d411178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:39:45 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] Volume bc51d3d4-9d0c-42e1-9c6e-afcbcfb27378: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc51d3d4-9d0c-42e1-9c6e-afcbcfb27378', 'volume_size': 1} Jul 17 19:39:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:39:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:39:45 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1589870522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc51d3d4-9d0c-42e1-9c6e-afcbcfb27378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f46be6da70a41ceab78a2b8d617b191',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:39:45Z,use_quota=True,user_id='ac7a2ba516d9459d8103f2d46619dcdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:39:45 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] Creating volume bc51d3d4-9d0c-42e1-9c6e-afcbcfb27378 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:39:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:39:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:39:45 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:39:45 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:39:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:39:45 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:39:45 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:39:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bc51d3d4-9d0c-42e1-9c6e-afcbcfb27378 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:39:45 devstack sudo[92073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bc51d3d4-9d0c-42e1-9c6e-afcbcfb27378 1073741824 Jul 17 19:39:45 devstack sudo[92073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:39:45 devstack sudo[92069]: pam_unix(sudo:session): session closed for user root Jul 17 19:39:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5ab35027-480b-4707-bded-8bff79ca7493 tempest-TaggedAttachmentsTest-887101203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.735s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:39:45 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-5ab35027-480b-4707-bded-8bff79ca7493 tempest-TaggedAttachmentsTest-887101203 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:39:45 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-5ab35027-480b-4707-bded-8bff79ca7493 tempest-TaggedAttachmentsTest-887101203 None] Deleted volume successfully. Jul 17 19:39:45 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5ab35027-480b-4707-bded-8bff79ca7493 tempest-TaggedAttachmentsTest-887101203 None] Lock "cinder-9b3e0663-8da6-42ef-aa25-b77fb3c15c15-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:39:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a67b65a0-96b6-4c47-a469-e400ce5caef5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Acquiring lock "cinder-f7b37279-492e-49c4-8f5d-2e145313eb97-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:39:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a67b65a0-96b6-4c47-a469-e400ce5caef5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Lock "cinder-f7b37279-492e-49c4-8f5d-2e145313eb97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:39:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a67b65a0-96b6-4c47-a469-e400ce5caef5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Acquiring lock "cinder-quobyte-9550096d-18d9-4dfa-a790-d3a576b14bf1" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:39:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a67b65a0-96b6-4c47-a469-e400ce5caef5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Lock "cinder-quobyte-9550096d-18d9-4dfa-a790-d3a576b14bf1" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:39:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a67b65a0-96b6-4c47-a469-e400ce5caef5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Acquiring lock "cinder-quobyte-f7b37279-492e-49c4-8f5d-2e145313eb97" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:39:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a67b65a0-96b6-4c47-a469-e400ce5caef5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Lock "cinder-quobyte-f7b37279-492e-49c4-8f5d-2e145313eb97" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:39:46 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-a67b65a0-96b6-4c47-a469-e400ce5caef5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Deleting offline snapshot f7b37279-492e-49c4-8f5d-2e145313eb97 of volume 9550096d-18d9-4dfa-a790-d3a576b14bf1 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:39:46 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-a67b65a0-96b6-4c47-a469-e400ce5caef5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] snapshot_file for this snap is: volume-9550096d-18d9-4dfa-a790-d3a576b14bf1.f7b37279-492e-49c4-8f5d-2e145313eb97 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:39:46 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ded138e-1709-4713-8c35-1347babee968]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:39:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a67b65a0-96b6-4c47-a469-e400ce5caef5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1.f7b37279-492e-49c4-8f5d-2e145313eb97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:39:46 devstack sudo[92073]: pam_unix(sudo:session): session closed for user root Jul 17 19:39:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bc51d3d4-9d0c-42e1-9c6e-afcbcfb27378 1073741824" returned: 0 in 0.885s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:39:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bc51d3d4-9d0c-42e1-9c6e-afcbcfb27378 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:39:46 devstack sudo[92078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1.f7b37279-492e-49c4-8f5d-2e145313eb97 Jul 17 19:39:46 devstack sudo[92078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:39:46 devstack sudo[92081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bc51d3d4-9d0c-42e1-9c6e-afcbcfb27378 Jul 17 19:39:46 devstack sudo[92081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:39:47 devstack sudo[92078]: pam_unix(sudo:session): session closed for user root Jul 17 19:39:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a67b65a0-96b6-4c47-a469-e400ce5caef5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1.f7b37279-492e-49c4-8f5d-2e145313eb97" returned: 0 in 0.676s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:39:47 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-a67b65a0-96b6-4c47-a469-e400ce5caef5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9550096d-18d9-4dfa-a790-d3a576b14bf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:39:47 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f72e2b-a883-4080-9a74-a6ff6ac82e29]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:39:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a67b65a0-96b6-4c47-a469-e400ce5caef5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:39:47 devstack sudo[92081]: pam_unix(sudo:session): session closed for user root Jul 17 19:39:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bc51d3d4-9d0c-42e1-9c6e-afcbcfb27378" returned: 0 in 0.879s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:39:47 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:39:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:39:47 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66790be1-8a22-4977-a313-4a998d411178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc51d3d4-9d0c-42e1-9c6e-afcbcfb27378', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:39:47 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac7c3646-f7aa-4b01-b666-d8e158eb46ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:39:47 devstack sudo[92087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1 Jul 17 19:39:47 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] Volume volume-bc51d3d4-9d0c-42e1-9c6e-afcbcfb27378 (bc51d3d4-9d0c-42e1-9c6e-afcbcfb27378): created successfully Jul 17 19:39:47 devstack sudo[92087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:39:47 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac7c3646-f7aa-4b01-b666-d8e158eb46ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:39:47 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] Flow 'volume_create_manager' (03bede44-583a-4f43-b59b-eca6528d889e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:39:47 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-273e0518-c127-4166-885e-fd41da896057 tempest-ServerRescueNegativeTestJSON-705784400 None] Created volume successfully. Jul 17 19:39:48 devstack sudo[92087]: pam_unix(sudo:session): session closed for user root Jul 17 19:39:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a67b65a0-96b6-4c47-a469-e400ce5caef5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1" returned: 0 in 0.957s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:39:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a67b65a0-96b6-4c47-a469-e400ce5caef5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1.f7b37279-492e-49c4-8f5d-2e145313eb97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:39:48 devstack sudo[92093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1.f7b37279-492e-49c4-8f5d-2e145313eb97 Jul 17 19:39:48 devstack sudo[92093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:39:48 devstack sudo[92093]: pam_unix(sudo:session): session closed for user root Jul 17 19:39:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a67b65a0-96b6-4c47-a469-e400ce5caef5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1.f7b37279-492e-49c4-8f5d-2e145313eb97" returned: 0 in 0.680s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:39:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a67b65a0-96b6-4c47-a469-e400ce5caef5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1.f7b37279-492e-49c4-8f5d-2e145313eb97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:39:48 devstack sudo[92099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1.f7b37279-492e-49c4-8f5d-2e145313eb97 Jul 17 19:39:48 devstack sudo[92099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:39:49 devstack sudo[92099]: pam_unix(sudo:session): session closed for user root Jul 17 19:39:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a67b65a0-96b6-4c47-a469-e400ce5caef5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1.f7b37279-492e-49c4-8f5d-2e145313eb97" returned: 0 in 0.520s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:39:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a67b65a0-96b6-4c47-a469-e400ce5caef5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Lock "cinder-quobyte-f7b37279-492e-49c4-8f5d-2e145313eb97" released by "_delete_snapshot" :: held 3.070s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:39:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a67b65a0-96b6-4c47-a469-e400ce5caef5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Lock "cinder-quobyte-9550096d-18d9-4dfa-a790-d3a576b14bf1" released by "delete_snapshot" :: held 3.151s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:39:49 devstack cinder-volume[87726]: WARNING cinder.quota [None req-a67b65a0-96b6-4c47-a469-e400ce5caef5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:39:49 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-a67b65a0-96b6-4c47-a469-e400ce5caef5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Created reservations ['9ce7799a-634b-4f8a-9d87-dd1b9957f941', '858be832-8d3c-46be-8ce7-ed88aeb04995', 'ec0732f2-1ce6-4382-a6a1-1f1b65538f29', 'a1c538fd-014a-42c6-90a5-4f4c8d59997b'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:39:49 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-a67b65a0-96b6-4c47-a469-e400ce5caef5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Delete snapshot completed successfully. Jul 17 19:39:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a67b65a0-96b6-4c47-a469-e400ce5caef5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Lock "cinder-f7b37279-492e-49c4-8f5d-2e145313eb97-delete_snapshot" released by "delete_snapshot" :: held 3.566s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:39:50 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e1096ac8-cb1e-4d62-be76-41fe948379ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Acquiring lock "cinder-9550096d-18d9-4dfa-a790-d3a576b14bf1-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:39:50 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e1096ac8-cb1e-4d62-be76-41fe948379ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Lock "cinder-9550096d-18d9-4dfa-a790-d3a576b14bf1-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:39:51 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e1096ac8-cb1e-4d62-be76-41fe948379ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Acquiring lock "cinder-quobyte-9550096d-18d9-4dfa-a790-d3a576b14bf1" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:39:51 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e1096ac8-cb1e-4d62-be76-41fe948379ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Lock "cinder-quobyte-9550096d-18d9-4dfa-a790-d3a576b14bf1" acquired by "delete_volume" :: waited 0.046s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:39:51 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0215b9-70f3-450b-b036-59fa0f601751]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:39:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e1096ac8-cb1e-4d62-be76-41fe948379ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:39:51 devstack sudo[92114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1 Jul 17 19:39:51 devstack sudo[92114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:39:52 devstack sudo[92114]: pam_unix(sudo:session): session closed for user root Jul 17 19:39:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e1096ac8-cb1e-4d62-be76-41fe948379ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1" returned: 0 in 0.871s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:39:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e1096ac8-cb1e-4d62-be76-41fe948379ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:39:52 devstack sudo[92137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1 Jul 17 19:39:52 devstack sudo[92137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:39:52 devstack sudo[92137]: pam_unix(sudo:session): session closed for user root Jul 17 19:39:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e1096ac8-cb1e-4d62-be76-41fe948379ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9550096d-18d9-4dfa-a790-d3a576b14bf1" returned: 0 in 0.391s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:39:52 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e1096ac8-cb1e-4d62-be76-41fe948379ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Lock "cinder-quobyte-9550096d-18d9-4dfa-a790-d3a576b14bf1" released by "delete_volume" :: held 1.408s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:39:52 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-e1096ac8-cb1e-4d62-be76-41fe948379ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Created reservations ['6f2ca70a-e9c5-41af-a19b-b8e4182c78ae', '69318793-68f6-44e3-a842-7a9ec34802a2', '586e967f-7145-45d3-829f-9b8a5ef73c81', '4192fd00-3b41-40b2-a428-a80209f1f4c9'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:39:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e1096ac8-cb1e-4d62-be76-41fe948379ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:39:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e1096ac8-cb1e-4d62-be76-41fe948379ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:39:52 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e1096ac8-cb1e-4d62-be76-41fe948379ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:39:52 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e1096ac8-cb1e-4d62-be76-41fe948379ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:39:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e1096ac8-cb1e-4d62-be76-41fe948379ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:39:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e1096ac8-cb1e-4d62-be76-41fe948379ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:39:52 devstack sudo[92150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:39:52 devstack sudo[92150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:39:53 devstack sudo[92150]: pam_unix(sudo:session): session closed for user root Jul 17 19:39:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e1096ac8-cb1e-4d62-be76-41fe948379ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.290s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:39:53 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-e1096ac8-cb1e-4d62-be76-41fe948379ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:39:53 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e1096ac8-cb1e-4d62-be76-41fe948379ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Deleted volume successfully. Jul 17 19:39:53 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e1096ac8-cb1e-4d62-be76-41fe948379ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1981133169 None] Lock "cinder-9550096d-18d9-4dfa-a790-d3a576b14bf1-delete_volume" released by "delete_volume" :: held 2.175s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:40:01 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-59ce54fa-9793-413f-a656-8e73542de185 tempest-ServerRescueNegativeTestJSON-705784400 None] Acquiring lock "cinder-bc51d3d4-9d0c-42e1-9c6e-afcbcfb27378-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:40:01 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-59ce54fa-9793-413f-a656-8e73542de185 tempest-ServerRescueNegativeTestJSON-705784400 None] Lock "cinder-bc51d3d4-9d0c-42e1-9c6e-afcbcfb27378-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:40:02 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-59ce54fa-9793-413f-a656-8e73542de185 tempest-ServerRescueNegativeTestJSON-705784400 None] Acquiring lock "cinder-quobyte-bc51d3d4-9d0c-42e1-9c6e-afcbcfb27378" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:40:02 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-59ce54fa-9793-413f-a656-8e73542de185 tempest-ServerRescueNegativeTestJSON-705784400 None] Lock "cinder-quobyte-bc51d3d4-9d0c-42e1-9c6e-afcbcfb27378" acquired by "delete_volume" :: waited 0.045s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:40:02 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e53c030-7155-401b-a0ba-f474b21abb26]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:40:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-59ce54fa-9793-413f-a656-8e73542de185 tempest-ServerRescueNegativeTestJSON-705784400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bc51d3d4-9d0c-42e1-9c6e-afcbcfb27378 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:02 devstack sudo[92239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bc51d3d4-9d0c-42e1-9c6e-afcbcfb27378 Jul 17 19:40:02 devstack sudo[92239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:02 devstack sudo[92239]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-59ce54fa-9793-413f-a656-8e73542de185 tempest-ServerRescueNegativeTestJSON-705784400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bc51d3d4-9d0c-42e1-9c6e-afcbcfb27378" returned: 0 in 0.585s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-59ce54fa-9793-413f-a656-8e73542de185 tempest-ServerRescueNegativeTestJSON-705784400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bc51d3d4-9d0c-42e1-9c6e-afcbcfb27378 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:02 devstack sudo[92244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bc51d3d4-9d0c-42e1-9c6e-afcbcfb27378 Jul 17 19:40:02 devstack sudo[92244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:03 devstack sudo[92244]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-59ce54fa-9793-413f-a656-8e73542de185 tempest-ServerRescueNegativeTestJSON-705784400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bc51d3d4-9d0c-42e1-9c6e-afcbcfb27378" returned: 0 in 0.574s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:03 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-59ce54fa-9793-413f-a656-8e73542de185 tempest-ServerRescueNegativeTestJSON-705784400 None] Lock "cinder-quobyte-bc51d3d4-9d0c-42e1-9c6e-afcbcfb27378" released by "delete_volume" :: held 1.226s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:40:03 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-59ce54fa-9793-413f-a656-8e73542de185 tempest-ServerRescueNegativeTestJSON-705784400 None] Created reservations ['de8fc463-767a-4213-a1a8-06447ce63a29', '10ca095f-4a8c-430c-80ac-a3b9eae5faae', '7f3f4493-ad3a-4db1-b1f5-0a1efd7456fe', '18fb1f21-0e36-4db0-b54a-0701208778d0'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:40:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-59ce54fa-9793-413f-a656-8e73542de185 tempest-ServerRescueNegativeTestJSON-705784400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:40:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-59ce54fa-9793-413f-a656-8e73542de185 tempest-ServerRescueNegativeTestJSON-705784400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:40:03 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-59ce54fa-9793-413f-a656-8e73542de185 tempest-ServerRescueNegativeTestJSON-705784400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:40:03 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-59ce54fa-9793-413f-a656-8e73542de185 tempest-ServerRescueNegativeTestJSON-705784400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:40:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-59ce54fa-9793-413f-a656-8e73542de185 tempest-ServerRescueNegativeTestJSON-705784400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:40:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-59ce54fa-9793-413f-a656-8e73542de185 tempest-ServerRescueNegativeTestJSON-705784400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:03 devstack sudo[92247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:40:03 devstack sudo[92247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:03 devstack sudo[92247]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-59ce54fa-9793-413f-a656-8e73542de185 tempest-ServerRescueNegativeTestJSON-705784400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.350s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:03 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-59ce54fa-9793-413f-a656-8e73542de185 tempest-ServerRescueNegativeTestJSON-705784400 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:40:03 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-59ce54fa-9793-413f-a656-8e73542de185 tempest-ServerRescueNegativeTestJSON-705784400 None] Deleted volume successfully. Jul 17 19:40:03 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-59ce54fa-9793-413f-a656-8e73542de185 tempest-ServerRescueNegativeTestJSON-705784400 None] Lock "cinder-bc51d3d4-9d0c-42e1-9c6e-afcbcfb27378-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:40:06 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:40:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] Flow 'volume_create_manager' (90b9a95c-76d5-4ed1-80c2-0323dd043c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:40:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6442d67c-8e3e-4e70-aa6f-ea1edc9fd95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:40:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6442d67c-8e3e-4e70-aa6f-ea1edc9fd95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1957982625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d74e24a-1ff3-4732-b6d0-8d958f69ba28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ee1352233594adcb2c3239fdee52d97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:40:07Z,use_quota=True,user_id='a32610f6cc454fcb97fd02450faa4de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:40:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f842aa7-5d36-4099-8bc0-bb36034437f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:40:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f842aa7-5d36-4099-8bc0-bb36034437f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:40:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbefa4c4-a99f-4a75-b024-2cacd36c782a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:40:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbefa4c4-a99f-4a75-b024-2cacd36c782a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d74e24a-1ff3-4732-b6d0-8d958f69ba28', 'volume_name': 'volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:40:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8bb867d-2119-4783-9135-0d37cde24338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:40:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8bb867d-2119-4783-9135-0d37cde24338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:40:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7507713a-aa92-4ac4-982b-12857735e0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:40:06 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] Volume 5d74e24a-1ff3-4732-b6d0-8d958f69ba28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28', 'volume_size': 1} Jul 17 19:40:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:40:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:40:06 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1957982625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d74e24a-1ff3-4732-b6d0-8d958f69ba28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ee1352233594adcb2c3239fdee52d97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:40:07Z,use_quota=True,user_id='a32610f6cc454fcb97fd02450faa4de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:40:06 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] Creating volume 5d74e24a-1ff3-4732-b6d0-8d958f69ba28 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:40:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:40:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:40:06 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:40:06 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:40:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:40:06 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:40:06 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:40:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:06 devstack sudo[92282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28 1073741824 Jul 17 19:40:06 devstack sudo[92282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:07 devstack sudo[92282]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28 1073741824" returned: 0 in 0.722s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:07 devstack sudo[92288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28 Jul 17 19:40:07 devstack sudo[92288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:07 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:40:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] Flow 'volume_create_manager' (6f656364-971c-45c3-a606-f74ead52d1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:40:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7800e8b6-3239-43c9-91ff-4cf944f08460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:40:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7800e8b6-3239-43c9-91ff-4cf944f08460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1810821674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f150c640-aeb4-41fa-a36f-22478d702d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf6a028c572d4d2d8787ac09b717c92b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:40:08Z,use_quota=True,user_id='f44716a0ae154bab880d15c69ea4a8b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:40:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8f722a6-9732-4f23-8cb3-55172f51f0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:40:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8f722a6-9732-4f23-8cb3-55172f51f0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:40:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a94ea2-ceda-46d7-a308-0e2e60b018da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:40:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a94ea2-ceda-46d7-a308-0e2e60b018da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f150c640-aeb4-41fa-a36f-22478d702d07', 'volume_name': 'volume-f150c640-aeb4-41fa-a36f-22478d702d07', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:40:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd64cd65-0aea-4880-b96f-396856931156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:40:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd64cd65-0aea-4880-b96f-396856931156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:40:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b1562a-0a62-4831-9c1f-411c4e183c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:40:08 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] Volume f150c640-aeb4-41fa-a36f-22478d702d07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f150c640-aeb4-41fa-a36f-22478d702d07', 'volume_size': 1} Jul 17 19:40:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:40:08 devstack sudo[92288]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28" returned: 0 in 0.461s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:40:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:40:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.086s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:40:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1810821674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f150c640-aeb4-41fa-a36f-22478d702d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf6a028c572d4d2d8787ac09b717c92b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:40:08Z,use_quota=True,user_id='f44716a0ae154bab880d15c69ea4a8b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:40:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] Creating volume f150c640-aeb4-41fa-a36f-22478d702d07 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:40:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:40:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:40:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:40:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:40:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:40:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:40:08 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:40:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f150c640-aeb4-41fa-a36f-22478d702d07 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7507713a-aa92-4ac4-982b-12857735e0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:40:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7c7aa1-fac6-4590-a67e-46f7d7867bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:40:08 devstack sudo[92293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f150c640-aeb4-41fa-a36f-22478d702d07 1073741824 Jul 17 19:40:08 devstack sudo[92293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:08 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] Volume volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28 (5d74e24a-1ff3-4732-b6d0-8d958f69ba28): created successfully Jul 17 19:40:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7c7aa1-fac6-4590-a67e-46f7d7867bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:40:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] Flow 'volume_create_manager' (90b9a95c-76d5-4ed1-80c2-0323dd043c7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:40:08 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-bdeb6404-aa5d-4218-b290-b0d8577ece07 req-c6b9fa5f-c04c-4997-864c-d75448885965 tempest-VolumesSnapshotsTestJSON-1109681440 None] Created volume successfully. Jul 17 19:40:08 devstack sudo[92293]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f150c640-aeb4-41fa-a36f-22478d702d07 1073741824" returned: 0 in 0.755s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f150c640-aeb4-41fa-a36f-22478d702d07 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:09 devstack sudo[92321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f150c640-aeb4-41fa-a36f-22478d702d07 Jul 17 19:40:09 devstack sudo[92321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:09 devstack sudo[92321]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f150c640-aeb4-41fa-a36f-22478d702d07" returned: 0 in 0.444s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:40:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:40:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b1562a-0a62-4831-9c1f-411c4e183c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f150c640-aeb4-41fa-a36f-22478d702d07', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:40:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05da0839-8443-4046-9148-6bc5ff6c0073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:40:09 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] Volume volume-f150c640-aeb4-41fa-a36f-22478d702d07 (f150c640-aeb4-41fa-a36f-22478d702d07): created successfully Jul 17 19:40:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05da0839-8443-4046-9148-6bc5ff6c0073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:40:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] Flow 'volume_create_manager' (6f656364-971c-45c3-a606-f74ead52d1b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:40:09 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-50b3d524-d8fb-430d-b8b8-2fff8dc173b0 tempest-AttachVolumeShelveTestJSON-1029088150 None] Created volume successfully. Jul 17 19:40:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-0ca607e8-918d-4c02-a4d9-efcef5234068 req-9a71340d-58bc-4729-9b2b-b08a927ab74c tempest-VolumesSnapshotsTestJSON-1109681440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:40:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-0ca607e8-918d-4c02-a4d9-efcef5234068 req-9a71340d-58bc-4729-9b2b-b08a927ab74c tempest-VolumesSnapshotsTestJSON-1109681440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:40:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [req-0ca607e8-918d-4c02-a4d9-efcef5234068 req-9a71340d-58bc-4729-9b2b-b08a927ab74c tempest-VolumesSnapshotsTestJSON-1109681440 None] Creating offline snapshot 3c623a10-d946-44f2-a9cb-77b84ad31145 of volume 5d74e24a-1ff3-4732-b6d0-8d958f69ba28 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:40:09 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[3015f29c-e451-4bc5-bf69-1f15d9b0b464]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:40:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-0ca607e8-918d-4c02-a4d9-efcef5234068 req-9a71340d-58bc-4729-9b2b-b08a927ab74c tempest-VolumesSnapshotsTestJSON-1109681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:10 devstack sudo[92345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28 Jul 17 19:40:10 devstack sudo[92345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:10 devstack sudo[92345]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-0ca607e8-918d-4c02-a4d9-efcef5234068 req-9a71340d-58bc-4729-9b2b-b08a927ab74c tempest-VolumesSnapshotsTestJSON-1109681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28" returned: 0 in 0.636s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-0ca607e8-918d-4c02-a4d9-efcef5234068 req-9a71340d-58bc-4729-9b2b-b08a927ab74c tempest-VolumesSnapshotsTestJSON-1109681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28.3c623a10-d946-44f2-a9cb-77b84ad31145 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:10 devstack sudo[92353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28.3c623a10-d946-44f2-a9cb-77b84ad31145 1G Jul 17 19:40:10 devstack sudo[92353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:11 devstack sudo[92353]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-0ca607e8-918d-4c02-a4d9-efcef5234068 req-9a71340d-58bc-4729-9b2b-b08a927ab74c tempest-VolumesSnapshotsTestJSON-1109681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28.3c623a10-d946-44f2-a9cb-77b84ad31145 1G" returned: 0 in 0.600s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-0ca607e8-918d-4c02-a4d9-efcef5234068 req-9a71340d-58bc-4729-9b2b-b08a927ab74c tempest-VolumesSnapshotsTestJSON-1109681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28.3c623a10-d946-44f2-a9cb-77b84ad31145 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:11 devstack sudo[92358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28.3c623a10-d946-44f2-a9cb-77b84ad31145 Jul 17 19:40:11 devstack sudo[92358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:11 devstack sudo[92358]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-0ca607e8-918d-4c02-a4d9-efcef5234068 req-9a71340d-58bc-4729-9b2b-b08a927ab74c tempest-VolumesSnapshotsTestJSON-1109681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28.3c623a10-d946-44f2-a9cb-77b84ad31145" returned: 0 in 0.350s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:11 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [req-0ca607e8-918d-4c02-a4d9-efcef5234068 req-9a71340d-58bc-4729-9b2b-b08a927ab74c tempest-VolumesSnapshotsTestJSON-1109681440 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28.3c623a10-d946-44f2-a9cb-77b84ad31145 is being set with open permissions: ugo+rw Jul 17 19:40:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-0ca607e8-918d-4c02-a4d9-efcef5234068 req-9a71340d-58bc-4729-9b2b-b08a927ab74c tempest-VolumesSnapshotsTestJSON-1109681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28.3c623a10-d946-44f2-a9cb-77b84ad31145 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:11 devstack sudo[92363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28.3c623a10-d946-44f2-a9cb-77b84ad31145 Jul 17 19:40:11 devstack sudo[92363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:11 devstack sudo[92363]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-0ca607e8-918d-4c02-a4d9-efcef5234068 req-9a71340d-58bc-4729-9b2b-b08a927ab74c tempest-VolumesSnapshotsTestJSON-1109681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28.3c623a10-d946-44f2-a9cb-77b84ad31145" returned: 0 in 0.337s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-0ca607e8-918d-4c02-a4d9-efcef5234068 req-9a71340d-58bc-4729-9b2b-b08a927ab74c tempest-VolumesSnapshotsTestJSON-1109681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:11 devstack sudo[92369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28.info Jul 17 19:40:11 devstack sudo[92369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:12 devstack sudo[92369]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-0ca607e8-918d-4c02-a4d9-efcef5234068 req-9a71340d-58bc-4729-9b2b-b08a927ab74c tempest-VolumesSnapshotsTestJSON-1109681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28.info" returned: 0 in 0.350s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:12 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [req-0ca607e8-918d-4c02-a4d9-efcef5234068 req-9a71340d-58bc-4729-9b2b-b08a927ab74c tempest-VolumesSnapshotsTestJSON-1109681440 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28.info is being set with open permissions: ugo+rw Jul 17 19:40:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-0ca607e8-918d-4c02-a4d9-efcef5234068 req-9a71340d-58bc-4729-9b2b-b08a927ab74c tempest-VolumesSnapshotsTestJSON-1109681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:12 devstack sudo[92376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28.info Jul 17 19:40:12 devstack sudo[92376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:12 devstack sudo[92376]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-0ca607e8-918d-4c02-a4d9-efcef5234068 req-9a71340d-58bc-4729-9b2b-b08a927ab74c tempest-VolumesSnapshotsTestJSON-1109681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28.info" returned: 0 in 0.349s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-0ca607e8-918d-4c02-a4d9-efcef5234068 req-9a71340d-58bc-4729-9b2b-b08a927ab74c tempest-VolumesSnapshotsTestJSON-1109681440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.772s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:40:12 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-0ca607e8-918d-4c02-a4d9-efcef5234068 req-9a71340d-58bc-4729-9b2b-b08a927ab74c tempest-VolumesSnapshotsTestJSON-1109681440 None] Create snapshot completed successfully Jul 17 19:40:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [req-e035f6e9-360d-46d0-bfb6-67fb8285c7b1 req-f2748c2a-4b6d-429a-8332-541d60a323a4 tempest-VolumesSnapshotsTestJSON-1109681440 None] Acquiring lock "cinder-3c623a10-d946-44f2-a9cb-77b84ad31145-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:40:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [req-e035f6e9-360d-46d0-bfb6-67fb8285c7b1 req-f2748c2a-4b6d-429a-8332-541d60a323a4 tempest-VolumesSnapshotsTestJSON-1109681440 None] Lock "cinder-3c623a10-d946-44f2-a9cb-77b84ad31145-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:40:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [req-e035f6e9-360d-46d0-bfb6-67fb8285c7b1 req-f2748c2a-4b6d-429a-8332-541d60a323a4 tempest-VolumesSnapshotsTestJSON-1109681440 None] Acquiring lock "cinder-quobyte-5d74e24a-1ff3-4732-b6d0-8d958f69ba28" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:40:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [req-e035f6e9-360d-46d0-bfb6-67fb8285c7b1 req-f2748c2a-4b6d-429a-8332-541d60a323a4 tempest-VolumesSnapshotsTestJSON-1109681440 None] Lock "cinder-quobyte-5d74e24a-1ff3-4732-b6d0-8d958f69ba28" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:40:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [req-e035f6e9-360d-46d0-bfb6-67fb8285c7b1 req-f2748c2a-4b6d-429a-8332-541d60a323a4 tempest-VolumesSnapshotsTestJSON-1109681440 None] Acquiring lock "cinder-quobyte-3c623a10-d946-44f2-a9cb-77b84ad31145" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:40:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [req-e035f6e9-360d-46d0-bfb6-67fb8285c7b1 req-f2748c2a-4b6d-429a-8332-541d60a323a4 tempest-VolumesSnapshotsTestJSON-1109681440 None] Lock "cinder-quobyte-3c623a10-d946-44f2-a9cb-77b84ad31145" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:40:13 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [req-e035f6e9-360d-46d0-bfb6-67fb8285c7b1 req-f2748c2a-4b6d-429a-8332-541d60a323a4 tempest-VolumesSnapshotsTestJSON-1109681440 None] Deleting offline snapshot 3c623a10-d946-44f2-a9cb-77b84ad31145 of volume 5d74e24a-1ff3-4732-b6d0-8d958f69ba28 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:40:13 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [req-e035f6e9-360d-46d0-bfb6-67fb8285c7b1 req-f2748c2a-4b6d-429a-8332-541d60a323a4 tempest-VolumesSnapshotsTestJSON-1109681440 None] snapshot_file for this snap is: volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28.3c623a10-d946-44f2-a9cb-77b84ad31145 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:40:13 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae54252f-142a-4f13-a7e2-74ddc0326385]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:40:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-e035f6e9-360d-46d0-bfb6-67fb8285c7b1 req-f2748c2a-4b6d-429a-8332-541d60a323a4 tempest-VolumesSnapshotsTestJSON-1109681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28.3c623a10-d946-44f2-a9cb-77b84ad31145 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:13 devstack sudo[92387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28.3c623a10-d946-44f2-a9cb-77b84ad31145 Jul 17 19:40:13 devstack sudo[92387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:13 devstack sudo[92387]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-e035f6e9-360d-46d0-bfb6-67fb8285c7b1 req-f2748c2a-4b6d-429a-8332-541d60a323a4 tempest-VolumesSnapshotsTestJSON-1109681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28.3c623a10-d946-44f2-a9cb-77b84ad31145" returned: 0 in 0.522s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:13 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [req-e035f6e9-360d-46d0-bfb6-67fb8285c7b1 req-f2748c2a-4b6d-429a-8332-541d60a323a4 tempest-VolumesSnapshotsTestJSON-1109681440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:40:13 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[c615903d-bfee-4038-b76f-0fc71eafbb64]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:40:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-e035f6e9-360d-46d0-bfb6-67fb8285c7b1 req-f2748c2a-4b6d-429a-8332-541d60a323a4 tempest-VolumesSnapshotsTestJSON-1109681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:13 devstack sudo[92394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28 Jul 17 19:40:13 devstack sudo[92394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:14 devstack sudo[92394]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-e035f6e9-360d-46d0-bfb6-67fb8285c7b1 req-f2748c2a-4b6d-429a-8332-541d60a323a4 tempest-VolumesSnapshotsTestJSON-1109681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28" returned: 0 in 0.448s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-e035f6e9-360d-46d0-bfb6-67fb8285c7b1 req-f2748c2a-4b6d-429a-8332-541d60a323a4 tempest-VolumesSnapshotsTestJSON-1109681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28.3c623a10-d946-44f2-a9cb-77b84ad31145 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:14 devstack sudo[92399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28.3c623a10-d946-44f2-a9cb-77b84ad31145 Jul 17 19:40:14 devstack sudo[92399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:14 devstack sudo[92399]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-e035f6e9-360d-46d0-bfb6-67fb8285c7b1 req-f2748c2a-4b6d-429a-8332-541d60a323a4 tempest-VolumesSnapshotsTestJSON-1109681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28.3c623a10-d946-44f2-a9cb-77b84ad31145" returned: 0 in 0.497s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-e035f6e9-360d-46d0-bfb6-67fb8285c7b1 req-f2748c2a-4b6d-429a-8332-541d60a323a4 tempest-VolumesSnapshotsTestJSON-1109681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28.3c623a10-d946-44f2-a9cb-77b84ad31145 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:14 devstack sudo[92405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28.3c623a10-d946-44f2-a9cb-77b84ad31145 Jul 17 19:40:14 devstack sudo[92405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:15 devstack sudo[92405]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-e035f6e9-360d-46d0-bfb6-67fb8285c7b1 req-f2748c2a-4b6d-429a-8332-541d60a323a4 tempest-VolumesSnapshotsTestJSON-1109681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28.3c623a10-d946-44f2-a9cb-77b84ad31145" returned: 0 in 0.369s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:15 devstack cinder-volume[87726]: DEBUG cinder.coordination [req-e035f6e9-360d-46d0-bfb6-67fb8285c7b1 req-f2748c2a-4b6d-429a-8332-541d60a323a4 tempest-VolumesSnapshotsTestJSON-1109681440 None] Lock "cinder-quobyte-3c623a10-d946-44f2-a9cb-77b84ad31145" released by "_delete_snapshot" :: held 2.018s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:40:15 devstack cinder-volume[87726]: DEBUG cinder.coordination [req-e035f6e9-360d-46d0-bfb6-67fb8285c7b1 req-f2748c2a-4b6d-429a-8332-541d60a323a4 tempest-VolumesSnapshotsTestJSON-1109681440 None] Lock "cinder-quobyte-5d74e24a-1ff3-4732-b6d0-8d958f69ba28" released by "delete_snapshot" :: held 2.060s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:40:15 devstack cinder-volume[87726]: DEBUG cinder.quota [req-e035f6e9-360d-46d0-bfb6-67fb8285c7b1 req-f2748c2a-4b6d-429a-8332-541d60a323a4 tempest-VolumesSnapshotsTestJSON-1109681440 None] Created reservations ['3d7e43fe-9ee8-480c-9a4e-3524203b1790', '7a4d983d-b69e-43d1-bc25-b0a2d8f31ab1', 'a1bf2aff-da9f-4b35-962f-c79f825f16ef', '5a76500e-660a-45f3-a302-2b558a276294'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:40:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager._thread_info {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:40:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread count: 8 {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 19:40:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread info: [<_MainThread(MainThread, started 130066227544192)>, , , , , , , ] {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 19:40:15 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-e035f6e9-360d-46d0-bfb6-67fb8285c7b1 req-f2748c2a-4b6d-429a-8332-541d60a323a4 tempest-VolumesSnapshotsTestJSON-1109681440 None] Delete snapshot completed successfully. Jul 17 19:40:15 devstack cinder-volume[87726]: DEBUG cinder.coordination [req-e035f6e9-360d-46d0-bfb6-67fb8285c7b1 req-f2748c2a-4b6d-429a-8332-541d60a323a4 tempest-VolumesSnapshotsTestJSON-1109681440 None] Lock "cinder-3c623a10-d946-44f2-a9cb-77b84ad31145-delete_snapshot" released by "delete_snapshot" :: held 2.406s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:40:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [req-82336134-5f25-4a4a-8aeb-abe3a195666d req-088f5c02-f560-41e2-8621-c35e38a08db7 tempest-VolumesSnapshotsTestJSON-1109681440 None] Acquiring lock "cinder-5d74e24a-1ff3-4732-b6d0-8d958f69ba28-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:40:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [req-82336134-5f25-4a4a-8aeb-abe3a195666d req-088f5c02-f560-41e2-8621-c35e38a08db7 tempest-VolumesSnapshotsTestJSON-1109681440 None] Lock "cinder-5d74e24a-1ff3-4732-b6d0-8d958f69ba28-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:40:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [req-82336134-5f25-4a4a-8aeb-abe3a195666d req-088f5c02-f560-41e2-8621-c35e38a08db7 tempest-VolumesSnapshotsTestJSON-1109681440 None] Acquiring lock "cinder-quobyte-5d74e24a-1ff3-4732-b6d0-8d958f69ba28" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:40:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [req-82336134-5f25-4a4a-8aeb-abe3a195666d req-088f5c02-f560-41e2-8621-c35e38a08db7 tempest-VolumesSnapshotsTestJSON-1109681440 None] Lock "cinder-quobyte-5d74e24a-1ff3-4732-b6d0-8d958f69ba28" acquired by "delete_volume" :: waited 0.032s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:40:16 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b56259-98e8-4fe1-9bfc-114df59401da]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:40:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-82336134-5f25-4a4a-8aeb-abe3a195666d req-088f5c02-f560-41e2-8621-c35e38a08db7 tempest-VolumesSnapshotsTestJSON-1109681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:16 devstack sudo[92408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28 Jul 17 19:40:16 devstack sudo[92408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:17 devstack sudo[92408]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-82336134-5f25-4a4a-8aeb-abe3a195666d req-088f5c02-f560-41e2-8621-c35e38a08db7 tempest-VolumesSnapshotsTestJSON-1109681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28" returned: 0 in 0.481s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-82336134-5f25-4a4a-8aeb-abe3a195666d req-088f5c02-f560-41e2-8621-c35e38a08db7 tempest-VolumesSnapshotsTestJSON-1109681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:17 devstack sudo[92414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28 Jul 17 19:40:17 devstack sudo[92414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:17 devstack sudo[92414]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-82336134-5f25-4a4a-8aeb-abe3a195666d req-088f5c02-f560-41e2-8621-c35e38a08db7 tempest-VolumesSnapshotsTestJSON-1109681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5d74e24a-1ff3-4732-b6d0-8d958f69ba28" returned: 0 in 0.322s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:17 devstack cinder-volume[87726]: DEBUG cinder.coordination [req-82336134-5f25-4a4a-8aeb-abe3a195666d req-088f5c02-f560-41e2-8621-c35e38a08db7 tempest-VolumesSnapshotsTestJSON-1109681440 None] Lock "cinder-quobyte-5d74e24a-1ff3-4732-b6d0-8d958f69ba28" released by "delete_volume" :: held 0.890s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:40:17 devstack cinder-volume[87726]: DEBUG cinder.quota [req-82336134-5f25-4a4a-8aeb-abe3a195666d req-088f5c02-f560-41e2-8621-c35e38a08db7 tempest-VolumesSnapshotsTestJSON-1109681440 None] Created reservations ['8c143022-4c38-40ea-85ac-8d03df6afc81', '7e787827-7768-42f2-81fd-6262a7234dff', 'e8bf512f-ee9c-424e-89c6-596c4aef8757', '91867b8f-9c46-4341-a834-cd7519797f68'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:40:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-82336134-5f25-4a4a-8aeb-abe3a195666d req-088f5c02-f560-41e2-8621-c35e38a08db7 tempest-VolumesSnapshotsTestJSON-1109681440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:40:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-82336134-5f25-4a4a-8aeb-abe3a195666d req-088f5c02-f560-41e2-8621-c35e38a08db7 tempest-VolumesSnapshotsTestJSON-1109681440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:40:17 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [req-82336134-5f25-4a4a-8aeb-abe3a195666d req-088f5c02-f560-41e2-8621-c35e38a08db7 tempest-VolumesSnapshotsTestJSON-1109681440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:40:17 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [req-82336134-5f25-4a4a-8aeb-abe3a195666d req-088f5c02-f560-41e2-8621-c35e38a08db7 tempest-VolumesSnapshotsTestJSON-1109681440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:40:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-82336134-5f25-4a4a-8aeb-abe3a195666d req-088f5c02-f560-41e2-8621-c35e38a08db7 tempest-VolumesSnapshotsTestJSON-1109681440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:40:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-82336134-5f25-4a4a-8aeb-abe3a195666d req-088f5c02-f560-41e2-8621-c35e38a08db7 tempest-VolumesSnapshotsTestJSON-1109681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:17 devstack sudo[92418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:40:17 devstack sudo[92418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:18 devstack sudo[92418]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-82336134-5f25-4a4a-8aeb-abe3a195666d req-088f5c02-f560-41e2-8621-c35e38a08db7 tempest-VolumesSnapshotsTestJSON-1109681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.338s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:18 devstack cinder-volume[87726]: DEBUG cinder.manager [req-82336134-5f25-4a4a-8aeb-abe3a195666d req-088f5c02-f560-41e2-8621-c35e38a08db7 tempest-VolumesSnapshotsTestJSON-1109681440 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:40:18 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-82336134-5f25-4a4a-8aeb-abe3a195666d req-088f5c02-f560-41e2-8621-c35e38a08db7 tempest-VolumesSnapshotsTestJSON-1109681440 None] Deleted volume successfully. Jul 17 19:40:18 devstack cinder-volume[87726]: DEBUG cinder.coordination [req-82336134-5f25-4a4a-8aeb-abe3a195666d req-088f5c02-f560-41e2-8621-c35e38a08db7 tempest-VolumesSnapshotsTestJSON-1109681440 None] Lock "cinder-5d74e24a-1ff3-4732-b6d0-8d958f69ba28-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:40:27 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:UPDATE=52,cinder:SELECT=54,cinder:INSERT=14,cinder:DELETE=4 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:40:28 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=39,cinder:UPDATE=65,cinder:DELETE=6,cinder:INSERT=16 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:40:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-d077bf83-0242-4bf3-bc57-cda47ac3446a req-5f97767e-981a-4fc1-8f5d-25f07b1793d1 tempest-AttachVolumeShelveTestJSON-1029088150 None] No connector for attachment 8ea7e402-adf4-4ecd-b0bd-8a374fdaf812; skipping storage backend terminate_connection call. {{(pid=87726) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 17 19:40:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-d077bf83-0242-4bf3-bc57-cda47ac3446a req-5f97767e-981a-4fc1-8f5d-25f07b1793d1 tempest-AttachVolumeShelveTestJSON-1029088150 None] Deleting attachment 8ea7e402-adf4-4ecd-b0bd-8a374fdaf812. {{(pid=87726) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 19:40:31 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-f89e8990-6eb4-4fec-8fae-db51eaa99da2 tempest-GroupSnapshotsV319Test-1325173491 None] Group tempest-GroupSnapshotsV319Test-Group-1974802820: creating Jul 17 19:40:31 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-f89e8990-6eb4-4fec-8fae-db51eaa99da2 tempest-GroupSnapshotsV319Test-1325173491 None] Group tempest-GroupSnapshotsV319Test-Group-1974802820: created successfully Jul 17 19:40:31 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-f89e8990-6eb4-4fec-8fae-db51eaa99da2 tempest-GroupSnapshotsV319Test-1325173491 None] Create group completed successfully. Jul 17 19:40:33 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:40:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] Flow 'volume_create_manager' (f985b892-67dd-488c-be2b-fff371689c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:40:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2088bbdc-0fd9-4029-977c-ba2e4c03bfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:40:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2088bbdc-0fd9-4029-977c-ba2e4c03bfac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1799380326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6fadb370-8212-493f-8696-69360a028cff,host='devstack@QuobyteHD#QuobyteHD',id=b24c59e8-c4e8-4efc-ac94-4b688b744e7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdbde2ccf90d429493699a977d29b9c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:40:33Z,use_quota=True,user_id='09b3e805b8324c49b20efbadbcbfc6ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d3fc414-2a12-48e5-8b44-47369139379b),volume_type_id=9d3fc414-2a12-48e5-8b44-47369139379b)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:40:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (091301d7-8653-4d02-891b-2b70e39e4a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:40:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (091301d7-8653-4d02-891b-2b70e39e4a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:40:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9265022-ecc3-4d62-a1e0-dfed7ab11628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:40:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9265022-ecc3-4d62-a1e0-dfed7ab11628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b24c59e8-c4e8-4efc-ac94-4b688b744e7f', 'volume_name': 'volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:40:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72edbaff-357b-4ac2-a4c4-b1b6c000a15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:40:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72edbaff-357b-4ac2-a4c4-b1b6c000a15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:40:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3abdc483-a673-4fde-beb1-f04fc42e1a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:40:33 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] Volume b24c59e8-c4e8-4efc-ac94-4b688b744e7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f', 'volume_size': 1} Jul 17 19:40:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:40:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:40:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6fadb370-8212-493f-8696-69360a028cff,created_at=2026-07-17T17:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1799380326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6fadb370-8212-493f-8696-69360a028cff,host='devstack@QuobyteHD#QuobyteHD',id=b24c59e8-c4e8-4efc-ac94-4b688b744e7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdbde2ccf90d429493699a977d29b9c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:40:33Z,use_quota=True,user_id='09b3e805b8324c49b20efbadbcbfc6ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d3fc414-2a12-48e5-8b44-47369139379b),volume_type_id=9d3fc414-2a12-48e5-8b44-47369139379b)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:40:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] Creating volume b24c59e8-c4e8-4efc-ac94-4b688b744e7f {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:40:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:40:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:40:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:40:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:40:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:40:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:40:33 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:40:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:33 devstack sudo[92447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f 1073741824 Jul 17 19:40:33 devstack sudo[92447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:34 devstack sudo[92447]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f 1073741824" returned: 0 in 0.701s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:34 devstack sudo[92453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f Jul 17 19:40:34 devstack sudo[92453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:34 devstack sudo[92453]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f" returned: 0 in 0.370s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:34 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:40:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:40:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3abdc483-a673-4fde-beb1-f04fc42e1a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:40:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70dac8cc-02bf-4e97-9fac-1724e48f6fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:40:34 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] Volume volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f (b24c59e8-c4e8-4efc-ac94-4b688b744e7f): created successfully Jul 17 19:40:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70dac8cc-02bf-4e97-9fac-1724e48f6fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:40:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] Flow 'volume_create_manager' (f985b892-67dd-488c-be2b-fff371689c3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:40:34 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-bc71c0b3-ee74-45dc-b89a-1898970330ff tempest-GroupSnapshotsV319Test-1325173491 None] Created volume successfully. Jul 17 19:40:36 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-0086b84d-9e25-4604-8764-985669cb9bdb tempest-GroupSnapshotsV319Test-1325173491 None] GroupSnapshot 0d96663f-0573-47e7-a88d-84b41d763f43: creating. Jul 17 19:40:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0086b84d-9e25-4604-8764-985669cb9bdb tempest-GroupSnapshotsV319Test-1325173491 None] Group snapshot 0d96663f-0573-47e7-a88d-84b41d763f43: creating. {{(pid=87726) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 17 19:40:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0086b84d-9e25-4604-8764-985669cb9bdb tempest-GroupSnapshotsV319Test-1325173491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:40:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0086b84d-9e25-4604-8764-985669cb9bdb tempest-GroupSnapshotsV319Test-1325173491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:40:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-0086b84d-9e25-4604-8764-985669cb9bdb tempest-GroupSnapshotsV319Test-1325173491 None] Creating offline snapshot 0cd55d6d-2f2f-485a-96ff-f6565edbbbf2 of volume b24c59e8-c4e8-4efc-ac94-4b688b744e7f {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:40:36 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[7183426e-7a9a-4572-809c-c0407a8af75d]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:40:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0086b84d-9e25-4604-8764-985669cb9bdb tempest-GroupSnapshotsV319Test-1325173491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:36 devstack sudo[92464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f Jul 17 19:40:36 devstack sudo[92464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:37 devstack sudo[92464]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0086b84d-9e25-4604-8764-985669cb9bdb tempest-GroupSnapshotsV319Test-1325173491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f" returned: 0 in 0.470s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0086b84d-9e25-4604-8764-985669cb9bdb tempest-GroupSnapshotsV319Test-1325173491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f.0cd55d6d-2f2f-485a-96ff-f6565edbbbf2 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:37 devstack sudo[92471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f.0cd55d6d-2f2f-485a-96ff-f6565edbbbf2 1G Jul 17 19:40:37 devstack sudo[92471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:37 devstack sudo[92471]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0086b84d-9e25-4604-8764-985669cb9bdb tempest-GroupSnapshotsV319Test-1325173491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f.0cd55d6d-2f2f-485a-96ff-f6565edbbbf2 1G" returned: 0 in 0.675s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0086b84d-9e25-4604-8764-985669cb9bdb tempest-GroupSnapshotsV319Test-1325173491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f.0cd55d6d-2f2f-485a-96ff-f6565edbbbf2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:37 devstack sudo[92480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f.0cd55d6d-2f2f-485a-96ff-f6565edbbbf2 Jul 17 19:40:37 devstack sudo[92480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:38 devstack sudo[92480]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0086b84d-9e25-4604-8764-985669cb9bdb tempest-GroupSnapshotsV319Test-1325173491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f.0cd55d6d-2f2f-485a-96ff-f6565edbbbf2" returned: 0 in 0.519s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:38 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-0086b84d-9e25-4604-8764-985669cb9bdb tempest-GroupSnapshotsV319Test-1325173491 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f.0cd55d6d-2f2f-485a-96ff-f6565edbbbf2 is being set with open permissions: ugo+rw: NotImplementedError Jul 17 19:40:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0086b84d-9e25-4604-8764-985669cb9bdb tempest-GroupSnapshotsV319Test-1325173491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f.0cd55d6d-2f2f-485a-96ff-f6565edbbbf2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:38 devstack sudo[92491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f.0cd55d6d-2f2f-485a-96ff-f6565edbbbf2 Jul 17 19:40:38 devstack sudo[92491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:38 devstack sudo[92491]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0086b84d-9e25-4604-8764-985669cb9bdb tempest-GroupSnapshotsV319Test-1325173491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f.0cd55d6d-2f2f-485a-96ff-f6565edbbbf2" returned: 0 in 0.314s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0086b84d-9e25-4604-8764-985669cb9bdb tempest-GroupSnapshotsV319Test-1325173491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:38 devstack sudo[92503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f.info Jul 17 19:40:38 devstack sudo[92503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:39 devstack sudo[92503]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0086b84d-9e25-4604-8764-985669cb9bdb tempest-GroupSnapshotsV319Test-1325173491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f.info" returned: 0 in 0.526s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:39 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-0086b84d-9e25-4604-8764-985669cb9bdb tempest-GroupSnapshotsV319Test-1325173491 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f.info is being set with open permissions: ugo+rw: NotImplementedError Jul 17 19:40:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0086b84d-9e25-4604-8764-985669cb9bdb tempest-GroupSnapshotsV319Test-1325173491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:39 devstack sudo[92511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f.info Jul 17 19:40:39 devstack sudo[92511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:39 devstack sudo[92511]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0086b84d-9e25-4604-8764-985669cb9bdb tempest-GroupSnapshotsV319Test-1325173491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f.info" returned: 0 in 0.291s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0086b84d-9e25-4604-8764-985669cb9bdb tempest-GroupSnapshotsV319Test-1325173491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.964s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:40:39 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-0086b84d-9e25-4604-8764-985669cb9bdb tempest-GroupSnapshotsV319Test-1325173491 None] group_snapshot 0d96663f-0573-47e7-a88d-84b41d763f43: created successfully Jul 17 19:40:40 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e90d29d1-dafd-472a-a4df-f819a11c3768 tempest-GroupSnapshotsV319Test-1325173491 None] group_snapshot 0d96663f-0573-47e7-a88d-84b41d763f43: deleting Jul 17 19:40:40 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e90d29d1-dafd-472a-a4df-f819a11c3768 tempest-GroupSnapshotsV319Test-1325173491 None] group_snapshot 0d96663f-0573-47e7-a88d-84b41d763f43: deleting {{(pid=87726) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 17 19:40:40 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e90d29d1-dafd-472a-a4df-f819a11c3768 tempest-GroupSnapshotsV319Test-1325173491 None] Acquiring lock "cinder-quobyte-b24c59e8-c4e8-4efc-ac94-4b688b744e7f" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:40:40 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e90d29d1-dafd-472a-a4df-f819a11c3768 tempest-GroupSnapshotsV319Test-1325173491 None] Lock "cinder-quobyte-b24c59e8-c4e8-4efc-ac94-4b688b744e7f" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:40:40 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e90d29d1-dafd-472a-a4df-f819a11c3768 tempest-GroupSnapshotsV319Test-1325173491 None] Acquiring lock "cinder-quobyte-0cd55d6d-2f2f-485a-96ff-f6565edbbbf2" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:40:40 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e90d29d1-dafd-472a-a4df-f819a11c3768 tempest-GroupSnapshotsV319Test-1325173491 None] Lock "cinder-quobyte-0cd55d6d-2f2f-485a-96ff-f6565edbbbf2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:40:40 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-e90d29d1-dafd-472a-a4df-f819a11c3768 tempest-GroupSnapshotsV319Test-1325173491 None] Deleting offline snapshot 0cd55d6d-2f2f-485a-96ff-f6565edbbbf2 of volume b24c59e8-c4e8-4efc-ac94-4b688b744e7f {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:40:40 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-e90d29d1-dafd-472a-a4df-f819a11c3768 tempest-GroupSnapshotsV319Test-1325173491 None] snapshot_file for this snap is: volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f.0cd55d6d-2f2f-485a-96ff-f6565edbbbf2 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:40:40 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[80623b81-ec73-401c-8eb2-ebd774a1d1de]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:40:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e90d29d1-dafd-472a-a4df-f819a11c3768 tempest-GroupSnapshotsV319Test-1325173491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f.0cd55d6d-2f2f-485a-96ff-f6565edbbbf2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:40 devstack sudo[92528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f.0cd55d6d-2f2f-485a-96ff-f6565edbbbf2 Jul 17 19:40:40 devstack sudo[92528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:41 devstack sudo[92528]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e90d29d1-dafd-472a-a4df-f819a11c3768 tempest-GroupSnapshotsV319Test-1325173491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f.0cd55d6d-2f2f-485a-96ff-f6565edbbbf2" returned: 0 in 0.500s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:41 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-e90d29d1-dafd-472a-a4df-f819a11c3768 tempest-GroupSnapshotsV319Test-1325173491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:40:41 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[1725ab89-f6f3-4ac6-b231-d09aff7067a9]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:40:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e90d29d1-dafd-472a-a4df-f819a11c3768 tempest-GroupSnapshotsV319Test-1325173491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:41 devstack sudo[92536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f Jul 17 19:40:41 devstack sudo[92536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:41 devstack sudo[92536]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e90d29d1-dafd-472a-a4df-f819a11c3768 tempest-GroupSnapshotsV319Test-1325173491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f" returned: 0 in 0.501s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e90d29d1-dafd-472a-a4df-f819a11c3768 tempest-GroupSnapshotsV319Test-1325173491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f.0cd55d6d-2f2f-485a-96ff-f6565edbbbf2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:41 devstack sudo[92542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f.0cd55d6d-2f2f-485a-96ff-f6565edbbbf2 Jul 17 19:40:41 devstack sudo[92542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:42 devstack sudo[92542]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e90d29d1-dafd-472a-a4df-f819a11c3768 tempest-GroupSnapshotsV319Test-1325173491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f.0cd55d6d-2f2f-485a-96ff-f6565edbbbf2" returned: 0 in 0.483s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e90d29d1-dafd-472a-a4df-f819a11c3768 tempest-GroupSnapshotsV319Test-1325173491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f.0cd55d6d-2f2f-485a-96ff-f6565edbbbf2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:42 devstack sudo[92551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f.0cd55d6d-2f2f-485a-96ff-f6565edbbbf2 Jul 17 19:40:42 devstack sudo[92551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:42 devstack sudo[92551]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e90d29d1-dafd-472a-a4df-f819a11c3768 tempest-GroupSnapshotsV319Test-1325173491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f.0cd55d6d-2f2f-485a-96ff-f6565edbbbf2" returned: 0 in 0.343s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:42 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e90d29d1-dafd-472a-a4df-f819a11c3768 tempest-GroupSnapshotsV319Test-1325173491 None] Lock "cinder-quobyte-0cd55d6d-2f2f-485a-96ff-f6565edbbbf2" released by "_delete_snapshot" :: held 1.962s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:40:42 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e90d29d1-dafd-472a-a4df-f819a11c3768 tempest-GroupSnapshotsV319Test-1325173491 None] Lock "cinder-quobyte-b24c59e8-c4e8-4efc-ac94-4b688b744e7f" released by "delete_snapshot" :: held 1.993s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:40:42 devstack cinder-volume[87726]: WARNING cinder.quota [None req-e90d29d1-dafd-472a-a4df-f819a11c3768 tempest-GroupSnapshotsV319Test-1325173491 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1688589132 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1688589132, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:40:42 devstack cinder-volume[87726]: WARNING cinder.quota [None req-e90d29d1-dafd-472a-a4df-f819a11c3768 tempest-GroupSnapshotsV319Test-1325173491 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1688589132 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1688589132, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:40:42 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-e90d29d1-dafd-472a-a4df-f819a11c3768 tempest-GroupSnapshotsV319Test-1325173491 None] Created reservations ['3f3572e2-049b-4ddc-b7c6-28fcd586bf95', '0fb7d7db-de4a-419d-8083-637f5e185943', 'e9c64801-bcab-4d37-ac83-885488cf8ed9', 'ed77b3d9-0d75-4c59-aa7f-3e338ac13bc7'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:40:42 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e90d29d1-dafd-472a-a4df-f819a11c3768 tempest-GroupSnapshotsV319Test-1325173491 None] group_snapshot 0d96663f-0573-47e7-a88d-84b41d763f43: deleted successfully Jul 17 19:40:43 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-28d4c37e-763a-4b64-960e-4f57135b6a0d tempest-GroupSnapshotsV319Test-1325173491 None] Acquiring lock "cinder-quobyte-b24c59e8-c4e8-4efc-ac94-4b688b744e7f" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:40:43 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-28d4c37e-763a-4b64-960e-4f57135b6a0d tempest-GroupSnapshotsV319Test-1325173491 None] Lock "cinder-quobyte-b24c59e8-c4e8-4efc-ac94-4b688b744e7f" acquired by "delete_volume" :: waited 0.032s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:40:43 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef19df4d-4673-4b42-b87f-d81c41d6dcd2]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:40:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-28d4c37e-763a-4b64-960e-4f57135b6a0d tempest-GroupSnapshotsV319Test-1325173491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:44 devstack sudo[92662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f Jul 17 19:40:44 devstack sudo[92662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:44 devstack sudo[92662]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-28d4c37e-763a-4b64-960e-4f57135b6a0d tempest-GroupSnapshotsV319Test-1325173491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f" returned: 0 in 0.913s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-28d4c37e-763a-4b64-960e-4f57135b6a0d tempest-GroupSnapshotsV319Test-1325173491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:44 devstack sudo[92693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f Jul 17 19:40:44 devstack sudo[92693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:45 devstack sudo[92693]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-28d4c37e-763a-4b64-960e-4f57135b6a0d tempest-GroupSnapshotsV319Test-1325173491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b24c59e8-c4e8-4efc-ac94-4b688b744e7f" returned: 0 in 0.701s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:45 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-28d4c37e-763a-4b64-960e-4f57135b6a0d tempest-GroupSnapshotsV319Test-1325173491 None] Lock "cinder-quobyte-b24c59e8-c4e8-4efc-ac94-4b688b744e7f" released by "delete_volume" :: held 1.796s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:40:45 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-28d4c37e-763a-4b64-960e-4f57135b6a0d tempest-GroupSnapshotsV319Test-1325173491 None] Created reservations ['7c7bf950-0322-4aed-a480-ba126c79cc94'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:40:45 devstack cinder-volume[87726]: WARNING cinder.quota [None req-28d4c37e-763a-4b64-960e-4f57135b6a0d tempest-GroupSnapshotsV319Test-1325173491 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1688589132 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1688589132, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:40:45 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-28d4c37e-763a-4b64-960e-4f57135b6a0d tempest-GroupSnapshotsV319Test-1325173491 None] Created reservations ['e1b6f665-d70f-4cad-8887-5c41821bf0fb', '2b6c4090-5736-47d0-bb5d-75cf6223c88c', '4ec6582a-56aa-4d0c-a43f-327d1278adf3', '443f0af2-ed65-4bba-9dcf-fa380ebdfda6'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:40:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-28d4c37e-763a-4b64-960e-4f57135b6a0d tempest-GroupSnapshotsV319Test-1325173491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:40:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-28d4c37e-763a-4b64-960e-4f57135b6a0d tempest-GroupSnapshotsV319Test-1325173491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:40:45 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-28d4c37e-763a-4b64-960e-4f57135b6a0d tempest-GroupSnapshotsV319Test-1325173491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:40:45 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-28d4c37e-763a-4b64-960e-4f57135b6a0d tempest-GroupSnapshotsV319Test-1325173491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:40:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-28d4c37e-763a-4b64-960e-4f57135b6a0d tempest-GroupSnapshotsV319Test-1325173491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:40:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-28d4c37e-763a-4b64-960e-4f57135b6a0d tempest-GroupSnapshotsV319Test-1325173491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:45 devstack sudo[92745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:40:45 devstack sudo[92745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:46 devstack sudo[92745]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-28d4c37e-763a-4b64-960e-4f57135b6a0d tempest-GroupSnapshotsV319Test-1325173491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.520s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:46 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-28d4c37e-763a-4b64-960e-4f57135b6a0d tempest-GroupSnapshotsV319Test-1325173491 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:40:46 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-28d4c37e-763a-4b64-960e-4f57135b6a0d tempest-GroupSnapshotsV319Test-1325173491 None] Delete group completed successfully. Jul 17 19:40:51 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:40:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] Flow 'volume_create_manager' (e8ae6f60-0e1a-495c-903b-b49c222ff90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:40:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2abbc83a-804f-4fcc-a04e-25d0b812a4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:40:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2abbc83a-804f-4fcc-a04e-25d0b812a4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2069219171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49cefc02-0232-4a4c-b66d-cebcb63fc7b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15efb592bb14fac8540a5138f6ac99a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:40:51Z,use_quota=True,user_id='45025165f8214136a15334c0f5b629cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:40:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbedac60-0c11-483b-9d2f-91e30aac32b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:40:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbedac60-0c11-483b-9d2f-91e30aac32b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:40:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e75810-16ee-4a45-8cfb-18faeb0d4e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:40:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e75810-16ee-4a45-8cfb-18faeb0d4e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49cefc02-0232-4a4c-b66d-cebcb63fc7b9', 'volume_name': 'volume-49cefc02-0232-4a4c-b66d-cebcb63fc7b9', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:40:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f6adce-18a7-42db-bfc8-c1cf2ab49e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:40:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f6adce-18a7-42db-bfc8-c1cf2ab49e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:40:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c525887-e33c-487f-a15e-ea93a7eb1f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:40:51 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] Volume 49cefc02-0232-4a4c-b66d-cebcb63fc7b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49cefc02-0232-4a4c-b66d-cebcb63fc7b9', 'volume_size': 1} Jul 17 19:40:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:40:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:40:51 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2069219171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49cefc02-0232-4a4c-b66d-cebcb63fc7b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15efb592bb14fac8540a5138f6ac99a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:40:51Z,use_quota=True,user_id='45025165f8214136a15334c0f5b629cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:40:51 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] Creating volume 49cefc02-0232-4a4c-b66d-cebcb63fc7b9 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:40:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:40:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:40:51 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:40:51 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:40:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:40:51 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:40:51 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:40:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-49cefc02-0232-4a4c-b66d-cebcb63fc7b9 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:51 devstack sudo[92838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-49cefc02-0232-4a4c-b66d-cebcb63fc7b9 1073741824 Jul 17 19:40:51 devstack sudo[92838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:53 devstack sudo[92838]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-49cefc02-0232-4a4c-b66d-cebcb63fc7b9 1073741824" returned: 0 in 1.609s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-49cefc02-0232-4a4c-b66d-cebcb63fc7b9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:53 devstack sudo[92849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-49cefc02-0232-4a4c-b66d-cebcb63fc7b9 Jul 17 19:40:53 devstack sudo[92849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:54 devstack sudo[92849]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-49cefc02-0232-4a4c-b66d-cebcb63fc7b9" returned: 0 in 0.837s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:54 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] <== create_volume: return (2563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:40:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.576s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:40:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c525887-e33c-487f-a15e-ea93a7eb1f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49cefc02-0232-4a4c-b66d-cebcb63fc7b9', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:40:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77437a26-4000-4fe2-946f-a6464562c4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:40:54 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] Volume volume-49cefc02-0232-4a4c-b66d-cebcb63fc7b9 (49cefc02-0232-4a4c-b66d-cebcb63fc7b9): created successfully Jul 17 19:40:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77437a26-4000-4fe2-946f-a6464562c4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:40:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] Flow 'volume_create_manager' (e8ae6f60-0e1a-495c-903b-b49c222ff90f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:40:54 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-4a817cd5-fecb-48d5-b810-956e5d8e1bfe tempest-VolumesActionsTest-931794454 None] Created volume successfully. Jul 17 19:40:54 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-29f2c145-d367-46b1-a35f-4503e2bffeb4 tempest-VolumesActionsTest-931794454 None] Acquiring lock "cinder-49cefc02-0232-4a4c-b66d-cebcb63fc7b9" by "attach_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:40:54 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-29f2c145-d367-46b1-a35f-4503e2bffeb4 tempest-VolumesActionsTest-931794454 None] Lock "cinder-49cefc02-0232-4a4c-b66d-cebcb63fc7b9" acquired by "attach_volume" :: waited 0.058s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:40:55 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-29f2c145-d367-46b1-a35f-4503e2bffeb4 tempest-VolumesActionsTest-931794454 None] Attaching volume 49cefc02-0232-4a4c-b66d-cebcb63fc7b9 to instance 55536935-b2ac-4cbe-ac4a-b084cb81a4a3 at mountpoint /dev/vdb on host None. Jul 17 19:40:55 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-29f2c145-d367-46b1-a35f-4503e2bffeb4 tempest-VolumesActionsTest-931794454 None] Attach volume completed successfully. Jul 17 19:40:55 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-29f2c145-d367-46b1-a35f-4503e2bffeb4 tempest-VolumesActionsTest-931794454 None] Lock "cinder-49cefc02-0232-4a4c-b66d-cebcb63fc7b9" released by "attach_volume" :: held 0.329s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:40:57 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-42cc8acb-cc1b-4268-b7bd-fa69ab9d8665 tempest-VolumesActionsTest-902439597 None] Terminate volume connection completed successfully. Jul 17 19:40:57 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-42cc8acb-cc1b-4268-b7bd-fa69ab9d8665 tempest-VolumesActionsTest-902439597 None] Acquiring lock "cinder-49cefc02-0232-4a4c-b66d-cebcb63fc7b9-detach_volume" by "detach_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:40:57 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-42cc8acb-cc1b-4268-b7bd-fa69ab9d8665 tempest-VolumesActionsTest-902439597 None] Lock "cinder-49cefc02-0232-4a4c-b66d-cebcb63fc7b9-detach_volume" acquired by "detach_volume" :: waited 0.064s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:40:57 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-42cc8acb-cc1b-4268-b7bd-fa69ab9d8665 tempest-VolumesActionsTest-902439597 None] Detaching volume 49cefc02-0232-4a4c-b66d-cebcb63fc7b9 from instance 55536935-b2ac-4cbe-ac4a-b084cb81a4a3. Jul 17 19:40:57 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-42cc8acb-cc1b-4268-b7bd-fa69ab9d8665 tempest-VolumesActionsTest-902439597 None] Detach volume completed successfully. Jul 17 19:40:57 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-42cc8acb-cc1b-4268-b7bd-fa69ab9d8665 tempest-VolumesActionsTest-902439597 None] Lock "cinder-49cefc02-0232-4a4c-b66d-cebcb63fc7b9-detach_volume" released by "detach_volume" :: held 0.214s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:40:58 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-bea55faa-97fb-4175-b636-90ff7870067b tempest-VolumesActionsTest-931794454 None] Acquiring lock "cinder-49cefc02-0232-4a4c-b66d-cebcb63fc7b9-detach_volume" by "detach_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:40:58 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-bea55faa-97fb-4175-b636-90ff7870067b tempest-VolumesActionsTest-931794454 None] Lock "cinder-49cefc02-0232-4a4c-b66d-cebcb63fc7b9-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:40:58 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-bea55faa-97fb-4175-b636-90ff7870067b tempest-VolumesActionsTest-931794454 None] Volume detach called, but volume not attached. Jul 17 19:40:58 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-bea55faa-97fb-4175-b636-90ff7870067b tempest-VolumesActionsTest-931794454 None] Lock "cinder-49cefc02-0232-4a4c-b66d-cebcb63fc7b9-detach_volume" released by "detach_volume" :: held 0.028s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:40:58 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6c139cf9-a14c-4b6d-bc6d-878ef4b8c765 tempest-VolumesActionsTest-931794454 None] Acquiring lock "cinder-49cefc02-0232-4a4c-b66d-cebcb63fc7b9-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:40:58 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6c139cf9-a14c-4b6d-bc6d-878ef4b8c765 tempest-VolumesActionsTest-931794454 None] Lock "cinder-49cefc02-0232-4a4c-b66d-cebcb63fc7b9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:40:58 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6c139cf9-a14c-4b6d-bc6d-878ef4b8c765 tempest-VolumesActionsTest-931794454 None] Acquiring lock "cinder-quobyte-49cefc02-0232-4a4c-b66d-cebcb63fc7b9" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:40:58 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6c139cf9-a14c-4b6d-bc6d-878ef4b8c765 tempest-VolumesActionsTest-931794454 None] Lock "cinder-quobyte-49cefc02-0232-4a4c-b66d-cebcb63fc7b9" acquired by "delete_volume" :: waited 0.040s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:40:58 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2224191-5bf4-4f98-ab31-349e8007f10a]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:40:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6c139cf9-a14c-4b6d-bc6d-878ef4b8c765 tempest-VolumesActionsTest-931794454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-49cefc02-0232-4a4c-b66d-cebcb63fc7b9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:59 devstack sudo[92876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-49cefc02-0232-4a4c-b66d-cebcb63fc7b9 Jul 17 19:40:59 devstack sudo[92876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:40:59 devstack sudo[92876]: pam_unix(sudo:session): session closed for user root Jul 17 19:40:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6c139cf9-a14c-4b6d-bc6d-878ef4b8c765 tempest-VolumesActionsTest-931794454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-49cefc02-0232-4a4c-b66d-cebcb63fc7b9" returned: 0 in 0.796s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:40:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6c139cf9-a14c-4b6d-bc6d-878ef4b8c765 tempest-VolumesActionsTest-931794454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-49cefc02-0232-4a4c-b66d-cebcb63fc7b9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:40:59 devstack sudo[92882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-49cefc02-0232-4a4c-b66d-cebcb63fc7b9 Jul 17 19:40:59 devstack sudo[92882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:00 devstack sudo[92882]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6c139cf9-a14c-4b6d-bc6d-878ef4b8c765 tempest-VolumesActionsTest-931794454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-49cefc02-0232-4a4c-b66d-cebcb63fc7b9" returned: 0 in 0.600s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:00 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6c139cf9-a14c-4b6d-bc6d-878ef4b8c765 tempest-VolumesActionsTest-931794454 None] Lock "cinder-quobyte-49cefc02-0232-4a4c-b66d-cebcb63fc7b9" released by "delete_volume" :: held 1.535s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:41:00 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-6c139cf9-a14c-4b6d-bc6d-878ef4b8c765 tempest-VolumesActionsTest-931794454 None] Created reservations ['a77ad6e1-4541-442a-8839-15be8411f88f', '85e16acc-2992-40d9-951d-d835239133c4', '5c15c2f9-7a57-45fc-93b3-8f56d44bf3e0', 'c95a59ec-72fc-406a-bc47-f5696c21275f'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:41:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6c139cf9-a14c-4b6d-bc6d-878ef4b8c765 tempest-VolumesActionsTest-931794454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6c139cf9-a14c-4b6d-bc6d-878ef4b8c765 tempest-VolumesActionsTest-931794454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:00 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6c139cf9-a14c-4b6d-bc6d-878ef4b8c765 tempest-VolumesActionsTest-931794454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:41:00 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6c139cf9-a14c-4b6d-bc6d-878ef4b8c765 tempest-VolumesActionsTest-931794454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:41:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6c139cf9-a14c-4b6d-bc6d-878ef4b8c765 tempest-VolumesActionsTest-931794454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6c139cf9-a14c-4b6d-bc6d-878ef4b8c765 tempest-VolumesActionsTest-931794454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:00 devstack sudo[92885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:41:00 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:01 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6c139cf9-a14c-4b6d-bc6d-878ef4b8c765 tempest-VolumesActionsTest-931794454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.779s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:01 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-6c139cf9-a14c-4b6d-bc6d-878ef4b8c765 tempest-VolumesActionsTest-931794454 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:41:01 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-6c139cf9-a14c-4b6d-bc6d-878ef4b8c765 tempest-VolumesActionsTest-931794454 None] Deleted volume successfully. Jul 17 19:41:01 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6c139cf9-a14c-4b6d-bc6d-878ef4b8c765 tempest-VolumesActionsTest-931794454 None] Lock "cinder-49cefc02-0232-4a4c-b66d-cebcb63fc7b9-delete_volume" released by "delete_volume" :: held 2.965s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:41:03 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-8b8657f6-4940-4d04-8d86-9e8d14cca578 tempest-GroupsV314Test-255385181 None] Group tempest-GroupsV314Test-Group-1147730672: creating Jul 17 19:41:03 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-8b8657f6-4940-4d04-8d86-9e8d14cca578 tempest-GroupsV314Test-255385181 None] Group tempest-GroupsV314Test-Group-1147730672: created successfully Jul 17 19:41:03 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-8b8657f6-4940-4d04-8d86-9e8d14cca578 tempest-GroupsV314Test-255385181 None] Create group completed successfully. Jul 17 19:41:06 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:41:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] Flow 'volume_create_manager' (e2e9e9a9-85c1-42b0-aa77-91b669011242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:41:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e589e55-d19a-4236-878f-0cfc2dc8ad9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e589e55-d19a-4236-878f-0cfc2dc8ad9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1421691780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d1aba3d9-f07a-4b17-8758-20883c90307f,host='devstack@QuobyteHD#QuobyteHD',id=cef08fb0-2194-4d9d-a123-da9ddccfd450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb209ab0e42468799796a8379601d03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:41:06Z,use_quota=True,user_id='0cac5a7c74f1492aa9cd8004b5a3d219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(061c4387-e3fc-4650-be03-0f38137d4c87),volume_type_id=061c4387-e3fc-4650-be03-0f38137d4c87)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (439a2173-405f-4ed5-9e8b-ad03088ea1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (439a2173-405f-4ed5-9e8b-ad03088ea1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d965c99-f3c8-46b9-86b3-cd86a634d371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d965c99-f3c8-46b9-86b3-cd86a634d371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cef08fb0-2194-4d9d-a123-da9ddccfd450', 'volume_name': 'volume-cef08fb0-2194-4d9d-a123-da9ddccfd450', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42b13ea4-01fe-4164-b820-383d71a90c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42b13ea4-01fe-4164-b820-383d71a90c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a9db71-fcb8-49f6-9746-3d79ea504fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:06 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] Volume cef08fb0-2194-4d9d-a123-da9ddccfd450: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cef08fb0-2194-4d9d-a123-da9ddccfd450', 'volume_size': 1} Jul 17 19:41:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:06 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d1aba3d9-f07a-4b17-8758-20883c90307f,created_at=2026-07-17T17:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1421691780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d1aba3d9-f07a-4b17-8758-20883c90307f,host='devstack@QuobyteHD#QuobyteHD',id=cef08fb0-2194-4d9d-a123-da9ddccfd450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb209ab0e42468799796a8379601d03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:41:06Z,use_quota=True,user_id='0cac5a7c74f1492aa9cd8004b5a3d219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(061c4387-e3fc-4650-be03-0f38137d4c87),volume_type_id=061c4387-e3fc-4650-be03-0f38137d4c87)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:41:06 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] Creating volume cef08fb0-2194-4d9d-a123-da9ddccfd450 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:41:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:06 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:41:06 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:41:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:06 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:41:06 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:41:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:06 devstack sudo[92998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450 1073741824 Jul 17 19:41:06 devstack sudo[92998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:07 devstack sudo[92998]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450 1073741824" returned: 0 in 0.719s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:07 devstack sudo[93006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450 Jul 17 19:41:07 devstack sudo[93006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:07 devstack sudo[93006]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450" returned: 0 in 0.273s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:07 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:41:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a9db71-fcb8-49f6-9746-3d79ea504fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cef08fb0-2194-4d9d-a123-da9ddccfd450', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d57baa8-5111-4d64-928f-62faf2dcc038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:07 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] Volume volume-cef08fb0-2194-4d9d-a123-da9ddccfd450 (cef08fb0-2194-4d9d-a123-da9ddccfd450): created successfully Jul 17 19:41:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d57baa8-5111-4d64-928f-62faf2dcc038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] Flow 'volume_create_manager' (e2e9e9a9-85c1-42b0-aa77-91b669011242) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:41:07 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-98fee724-f497-425c-8c47-9b868b2d0f1f tempest-GroupsV314Test-255385181 None] Created volume successfully. Jul 17 19:41:08 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:41:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] Flow 'volume_create_manager' (68006cd9-9c51-4579-9bec-2e9cdd9abb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:41:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86af26e4-36e4-485f-bfd1-99a5629228fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86af26e4-36e4-485f-bfd1-99a5629228fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1687284630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ec92517-51f8-427d-90ae-98d947fa1706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15efb592bb14fac8540a5138f6ac99a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:41:08Z,use_quota=True,user_id='45025165f8214136a15334c0f5b629cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d342ae81-1126-4b64-b200-394868c4d8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d342ae81-1126-4b64-b200-394868c4d8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a96eda94-80cd-4480-b9f6-2ca2bc2144f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a96eda94-80cd-4480-b9f6-2ca2bc2144f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ec92517-51f8-427d-90ae-98d947fa1706', 'volume_name': 'volume-2ec92517-51f8-427d-90ae-98d947fa1706', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e301633b-7fef-464c-83fd-6e3003e95f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e301633b-7fef-464c-83fd-6e3003e95f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acde639c-071c-427a-8383-8dd74ec1dd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:08 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] Volume 2ec92517-51f8-427d-90ae-98d947fa1706: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ec92517-51f8-427d-90ae-98d947fa1706', 'volume_size': 1} Jul 17 19:41:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1687284630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ec92517-51f8-427d-90ae-98d947fa1706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15efb592bb14fac8540a5138f6ac99a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:41:08Z,use_quota=True,user_id='45025165f8214136a15334c0f5b629cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:41:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] Creating volume 2ec92517-51f8-427d-90ae-98d947fa1706 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:41:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:41:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:41:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:41:08 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:41:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2ec92517-51f8-427d-90ae-98d947fa1706 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:08 devstack sudo[93012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2ec92517-51f8-427d-90ae-98d947fa1706 1073741824 Jul 17 19:41:08 devstack sudo[93012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:09 devstack sudo[93012]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2ec92517-51f8-427d-90ae-98d947fa1706 1073741824" returned: 0 in 1.048s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2ec92517-51f8-427d-90ae-98d947fa1706 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:09 devstack sudo[93048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2ec92517-51f8-427d-90ae-98d947fa1706 Jul 17 19:41:09 devstack sudo[93048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:10 devstack sudo[93048]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2ec92517-51f8-427d-90ae-98d947fa1706" returned: 0 in 0.580s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:41:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acde639c-071c-427a-8383-8dd74ec1dd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ec92517-51f8-427d-90ae-98d947fa1706', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (719b82e0-2851-4c4b-903a-44a66485406b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:10 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] Volume volume-2ec92517-51f8-427d-90ae-98d947fa1706 (2ec92517-51f8-427d-90ae-98d947fa1706): created successfully Jul 17 19:41:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (719b82e0-2851-4c4b-903a-44a66485406b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] Flow 'volume_create_manager' (68006cd9-9c51-4579-9bec-2e9cdd9abb34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:41:10 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-db8e93cc-5b86-4ec1-b544-54bfa5949585 tempest-VolumesActionsTest-931794454 None] Created volume successfully. Jul 17 19:41:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:10 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Cloning volume cef08fb0-2194-4d9d-a123-da9ddccfd450 to volume 698f294c-d0ce-4216-ab9a-c1793c4b6a13 Jul 17 19:41:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Creating offline snapshot 8fa21341-53d3-424e-b5cd-bba91033c637 of volume cef08fb0-2194-4d9d-a123-da9ddccfd450 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:41:10 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd30255-ef7f-42af-be26-e6046fbdf5d7]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:41:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-35c2a1c1-d2a3-46df-a533-9aa67a95b829 tempest-VolumesActionsTest-902439597 None] Acquiring lock "cinder-2ec92517-51f8-427d-90ae-98d947fa1706-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:41:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-35c2a1c1-d2a3-46df-a533-9aa67a95b829 tempest-VolumesActionsTest-902439597 None] Lock "cinder-2ec92517-51f8-427d-90ae-98d947fa1706-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:41:10 devstack sudo[93076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450 Jul 17 19:41:10 devstack sudo[93076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-35c2a1c1-d2a3-46df-a533-9aa67a95b829 tempest-VolumesActionsTest-902439597 None] Acquiring lock "cinder-quobyte-2ec92517-51f8-427d-90ae-98d947fa1706" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:41:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-35c2a1c1-d2a3-46df-a533-9aa67a95b829 tempest-VolumesActionsTest-902439597 None] Lock "cinder-quobyte-2ec92517-51f8-427d-90ae-98d947fa1706" acquired by "delete_volume" :: waited 0.033s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:41:10 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b50f718-e4d2-4426-9eaa-60426381aad0]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:41:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-35c2a1c1-d2a3-46df-a533-9aa67a95b829 tempest-VolumesActionsTest-902439597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2ec92517-51f8-427d-90ae-98d947fa1706 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:11 devstack sudo[93078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2ec92517-51f8-427d-90ae-98d947fa1706 Jul 17 19:41:11 devstack sudo[93078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:11 devstack sudo[93076]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450" returned: 0 in 0.557s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450.8fa21341-53d3-424e-b5cd-bba91033c637 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:11 devstack sudo[93084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450.8fa21341-53d3-424e-b5cd-bba91033c637 1G Jul 17 19:41:11 devstack sudo[93084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:11 devstack sudo[93078]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-35c2a1c1-d2a3-46df-a533-9aa67a95b829 tempest-VolumesActionsTest-902439597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2ec92517-51f8-427d-90ae-98d947fa1706" returned: 0 in 0.481s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-35c2a1c1-d2a3-46df-a533-9aa67a95b829 tempest-VolumesActionsTest-902439597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2ec92517-51f8-427d-90ae-98d947fa1706 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:11 devstack sudo[93090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2ec92517-51f8-427d-90ae-98d947fa1706 Jul 17 19:41:11 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:11 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:11 devstack sudo[93084]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450.8fa21341-53d3-424e-b5cd-bba91033c637 1G" returned: 0 in 0.513s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cef08fb0-2194-4d9d-a123-da9ddccfd450 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450.8fa21341-53d3-424e-b5cd-bba91033c637 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-35c2a1c1-d2a3-46df-a533-9aa67a95b829 tempest-VolumesActionsTest-902439597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2ec92517-51f8-427d-90ae-98d947fa1706" returned: 0 in 0.303s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:11 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-35c2a1c1-d2a3-46df-a533-9aa67a95b829 tempest-VolumesActionsTest-902439597 None] Lock "cinder-quobyte-2ec92517-51f8-427d-90ae-98d947fa1706" released by "delete_volume" :: held 0.846s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:41:11 devstack sudo[93097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cef08fb0-2194-4d9d-a123-da9ddccfd450 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450.8fa21341-53d3-424e-b5cd-bba91033c637 Jul 17 19:41:11 devstack sudo[93097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:11 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-35c2a1c1-d2a3-46df-a533-9aa67a95b829 tempest-VolumesActionsTest-902439597 None] Created reservations ['a366c059-a198-449d-b95f-e6b56d3fbd68', '8de70803-0bac-41f5-b47d-13cc9884e772', '24b05958-7734-41cd-bc26-b5c879bd6ad1', '68b5b841-7f98-4c71-b9a5-deec57045b38'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:41:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-35c2a1c1-d2a3-46df-a533-9aa67a95b829 tempest-VolumesActionsTest-902439597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-35c2a1c1-d2a3-46df-a533-9aa67a95b829 tempest-VolumesActionsTest-902439597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-35c2a1c1-d2a3-46df-a533-9aa67a95b829 tempest-VolumesActionsTest-902439597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:41:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-35c2a1c1-d2a3-46df-a533-9aa67a95b829 tempest-VolumesActionsTest-902439597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:41:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-35c2a1c1-d2a3-46df-a533-9aa67a95b829 tempest-VolumesActionsTest-902439597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-35c2a1c1-d2a3-46df-a533-9aa67a95b829 tempest-VolumesActionsTest-902439597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:11 devstack sudo[93099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:41:11 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:11 devstack sudo[93097]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cef08fb0-2194-4d9d-a123-da9ddccfd450 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450.8fa21341-53d3-424e-b5cd-bba91033c637" returned: 0 in 0.381s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:11 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450.8fa21341-53d3-424e-b5cd-bba91033c637 is being set with open permissions: ugo+rw: NotImplementedError Jul 17 19:41:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450.8fa21341-53d3-424e-b5cd-bba91033c637 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:12 devstack sudo[93104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450.8fa21341-53d3-424e-b5cd-bba91033c637 Jul 17 19:41:12 devstack sudo[93104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:12 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-35c2a1c1-d2a3-46df-a533-9aa67a95b829 tempest-VolumesActionsTest-902439597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.297s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:12 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-35c2a1c1-d2a3-46df-a533-9aa67a95b829 tempest-VolumesActionsTest-902439597 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:41:12 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-35c2a1c1-d2a3-46df-a533-9aa67a95b829 tempest-VolumesActionsTest-902439597 None] Deleted volume successfully. Jul 17 19:41:12 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-35c2a1c1-d2a3-46df-a533-9aa67a95b829 tempest-VolumesActionsTest-902439597 None] Lock "cinder-2ec92517-51f8-427d-90ae-98d947fa1706-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:41:12 devstack sudo[93104]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450.8fa21341-53d3-424e-b5cd-bba91033c637" returned: 0 in 0.560s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:12 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:41:12 devstack sudo[93108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450.info Jul 17 19:41:12 devstack sudo[93108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] Flow 'volume_create_manager' (d4e52aab-7e2f-4dd4-ba03-e7028abba506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:41:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f15e7cc7-a41a-4d8d-9333-5d2391cf261d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f15e7cc7-a41a-4d8d-9333-5d2391cf261d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-96590463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7864f21d-2232-4764-8d01-988464309a41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15efb592bb14fac8540a5138f6ac99a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:41:13Z,use_quota=True,user_id='45025165f8214136a15334c0f5b629cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a4f3ba-4160-492c-a200-c38d3def868f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a4f3ba-4160-492c-a200-c38d3def868f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95803ceb-2096-4524-a709-2c0268546c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95803ceb-2096-4524-a709-2c0268546c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7864f21d-2232-4764-8d01-988464309a41', 'volume_name': 'volume-7864f21d-2232-4764-8d01-988464309a41', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89cf82a3-a1a1-49b1-b52e-32edac2cb2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89cf82a3-a1a1-49b1-b52e-32edac2cb2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8200b673-293a-498e-8d17-90e5b44e8128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:12 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] Volume 7864f21d-2232-4764-8d01-988464309a41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7864f21d-2232-4764-8d01-988464309a41', 'volume_size': 1} Jul 17 19:41:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:12 devstack sudo[93108]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450.info" returned: 0 in 0.345s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:12 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450.info is being set with open permissions: ugo+rw: NotImplementedError Jul 17 19:41:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:13 devstack sudo[93111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450.info Jul 17 19:41:13 devstack sudo[93111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:13 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:41:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] Flow 'volume_create_manager' (f711c5c5-1908-46a9-a385-9c32ff9c737f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:41:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3cdd4f2-a236-472e-a711-b894f0d5f8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3cdd4f2-a236-472e-a711-b894f0d5f8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-704016594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0833be-a11a-44c0-a409-4116484584a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108acca2d75643a3a27efed93eb8712c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:41:13Z,use_quota=True,user_id='2e1d493e8d184418be2f4d64ca331aa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a24de5ac-3ee9-4c2d-9fe8-2d2fae1077b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a24de5ac-3ee9-4c2d-9fe8-2d2fae1077b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3a92391-4b7c-448a-9b57-074fc465183a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3a92391-4b7c-448a-9b57-074fc465183a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e0833be-a11a-44c0-a409-4116484584a3', 'volume_name': 'volume-3e0833be-a11a-44c0-a409-4116484584a3', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efbbae34-2830-447e-b4d9-c041b16755a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efbbae34-2830-447e-b4d9-c041b16755a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67fad8d0-49bc-45f6-96c1-6ff225a11219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:13 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] Volume 3e0833be-a11a-44c0-a409-4116484584a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e0833be-a11a-44c0-a409-4116484584a3', 'volume_size': 1} Jul 17 19:41:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:13 devstack sudo[93111]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450.info" returned: 0 in 0.289s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Acquiring lock "cinder-quobyte-698f294c-d0ce-4216-ab9a-c1793c4b6a13" by "_copy_volume_from_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:41:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Lock "cinder-quobyte-698f294c-d0ce-4216-ab9a-c1793c4b6a13" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:41:13 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] snapshot: 8fa21341-53d3-424e-b5cd-bba91033c637, volume: 698f294c-d0ce-4216-ab9a-c1793c4b6a13, {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 19:41:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:13 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:41:13 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:41:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:13 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecffb6a2-183a-4f86-9a3e-6512ab725456]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:41:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450.8fa21341-53d3-424e-b5cd-bba91033c637 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:13 devstack sudo[93114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450.8fa21341-53d3-424e-b5cd-bba91033c637 Jul 17 19:41:13 devstack sudo[93114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:13 devstack sudo[93114]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450.8fa21341-53d3-424e-b5cd-bba91033c637" returned: 0 in 0.367s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:13 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cef08fb0-2194-4d9d-a123-da9ddccfd450(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:41:13 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450 {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 19:41:13 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Creating direct copy from snapshot {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 19:41:13 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88e3404-3541-403c-abe3-b3bc3157667b]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:41:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:13 devstack sudo[93119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450 Jul 17 19:41:13 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:14 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450" returned: 0 in 0.384s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:14 devstack cinder-volume[87726]: DEBUG cinder.utils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Path /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-698f294c-d0ce-4216-ab9a-c1793c4b6a13 not found in is_blk_device check {{(pid=87726) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 19:41:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-698f294c-d0ce-4216-ab9a-c1793c4b6a13 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:14 devstack sudo[93125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-698f294c-d0ce-4216-ab9a-c1793c4b6a13 Jul 17 19:41:14 devstack sudo[93125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:41:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:41:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:41:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:15 devstack sudo[93137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:41:15 devstack sudo[93137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:15 devstack sudo[93137]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.641s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:15 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:41:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager._thread_info {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:41:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread count: 8 {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 19:41:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread info: [<_MainThread(MainThread, started 130066227544192)>, , , , , , , ] {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 19:41:19 devstack sudo[93125]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-698f294c-d0ce-4216-ab9a-c1793c4b6a13" returned: 0 in 4.984s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:19 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6aa5a8-bf14-4ca1-b527-823e4c86faf1]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:41:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:19 devstack sudo[93142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450 Jul 17 19:41:19 devstack sudo[93142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:19 devstack sudo[93142]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450" returned: 0 in 0.493s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:19 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Image conversion details: src /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450, size 1024.00 MB, duration 4.99 sec, destination /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-698f294c-d0ce-4216-ab9a-c1793c4b6a13 {{(pid=87726) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 19:41:19 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Converted 1024.00 MB image at 205.39 MB/s Jul 17 19:41:19 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-698f294c-d0ce-4216-ab9a-c1793c4b6a13 is being set with open permissions: ugo+rw: NotImplementedError Jul 17 19:41:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-698f294c-d0ce-4216-ab9a-c1793c4b6a13 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:19 devstack sudo[93148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-698f294c-d0ce-4216-ab9a-c1793c4b6a13 Jul 17 19:41:19 devstack sudo[93148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:19 devstack sudo[93148]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-698f294c-d0ce-4216-ab9a-c1793c4b6a13" returned: 0 in 0.237s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:19 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Lock "cinder-quobyte-698f294c-d0ce-4216-ab9a-c1793c4b6a13" released by "_copy_volume_from_snapshot" :: held 6.549s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:41:19 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Acquiring lock "cinder-quobyte-8fa21341-53d3-424e-b5cd-bba91033c637" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:41:19 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Lock "cinder-quobyte-8fa21341-53d3-424e-b5cd-bba91033c637" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:41:19 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Deleting offline snapshot 8fa21341-53d3-424e-b5cd-bba91033c637 of volume cef08fb0-2194-4d9d-a123-da9ddccfd450 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:41:19 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] snapshot_file for this snap is: volume-cef08fb0-2194-4d9d-a123-da9ddccfd450.8fa21341-53d3-424e-b5cd-bba91033c637 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:41:19 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aab9b8a-ab18-4bb7-83b9-a33d3af7e601]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:41:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450.8fa21341-53d3-424e-b5cd-bba91033c637 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:20 devstack sudo[93151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450.8fa21341-53d3-424e-b5cd-bba91033c637 Jul 17 19:41:20 devstack sudo[93151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:20 devstack sudo[93151]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450.8fa21341-53d3-424e-b5cd-bba91033c637" returned: 0 in 0.344s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:20 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cef08fb0-2194-4d9d-a123-da9ddccfd450(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:41:20 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[6890bf5e-57e1-4ad7-ad99-0f2b7f6b3095]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:41:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:20 devstack sudo[93156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450 Jul 17 19:41:20 devstack sudo[93156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:20 devstack sudo[93156]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450" returned: 0 in 0.339s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450.8fa21341-53d3-424e-b5cd-bba91033c637 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:20 devstack sudo[93162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450.8fa21341-53d3-424e-b5cd-bba91033c637 Jul 17 19:41:20 devstack sudo[93162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:20 devstack sudo[93162]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450.8fa21341-53d3-424e-b5cd-bba91033c637" returned: 0 in 0.341s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450.8fa21341-53d3-424e-b5cd-bba91033c637 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:21 devstack sudo[93167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450.8fa21341-53d3-424e-b5cd-bba91033c637 Jul 17 19:41:21 devstack sudo[93167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:21 devstack sudo[93167]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450.8fa21341-53d3-424e-b5cd-bba91033c637" returned: 0 in 0.236s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:21 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Lock "cinder-quobyte-8fa21341-53d3-424e-b5cd-bba91033c637" released by "_delete_snapshot" :: held 1.343s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:41:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.842s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.461s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-96590463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7864f21d-2232-4764-8d01-988464309a41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15efb592bb14fac8540a5138f6ac99a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:41:13Z,use_quota=True,user_id='45025165f8214136a15334c0f5b629cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:41:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] Creating volume 7864f21d-2232-4764-8d01-988464309a41 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:41:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:41:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:41:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:41:21 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:41:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7864f21d-2232-4764-8d01-988464309a41 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:21 devstack sudo[93170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7864f21d-2232-4764-8d01-988464309a41 1073741824 Jul 17 19:41:21 devstack sudo[93170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:21 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-8703545a-a3f2-46aa-b695-ed38a8c0b137 tempest-GroupsV314Test-255385181 None] Create group from source-group-d1aba3d9-f07a-4b17-8758-20883c90307f completed successfully. Jul 17 19:41:21 devstack sudo[93170]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7864f21d-2232-4764-8d01-988464309a41 1073741824" returned: 0 in 0.411s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7864f21d-2232-4764-8d01-988464309a41 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:21 devstack sudo[93175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7864f21d-2232-4764-8d01-988464309a41 Jul 17 19:41:21 devstack sudo[93175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:21 devstack sudo[93175]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7864f21d-2232-4764-8d01-988464309a41" returned: 0 in 0.261s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:41:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.862s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-704016594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0833be-a11a-44c0-a409-4116484584a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108acca2d75643a3a27efed93eb8712c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:41:13Z,use_quota=True,user_id='2e1d493e8d184418be2f4d64ca331aa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:41:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] Creating volume 3e0833be-a11a-44c0-a409-4116484584a3 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:41:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:41:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:41:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:41:21 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:41:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3e0833be-a11a-44c0-a409-4116484584a3 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8200b673-293a-498e-8d17-90e5b44e8128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7864f21d-2232-4764-8d01-988464309a41', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:22 devstack sudo[93178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3e0833be-a11a-44c0-a409-4116484584a3 1073741824 Jul 17 19:41:22 devstack sudo[93178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da1e7e4c-cfcd-42e5-8510-ef40672908e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:22 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] Volume volume-7864f21d-2232-4764-8d01-988464309a41 (7864f21d-2232-4764-8d01-988464309a41): created successfully Jul 17 19:41:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da1e7e4c-cfcd-42e5-8510-ef40672908e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] Flow 'volume_create_manager' (d4e52aab-7e2f-4dd4-ba03-e7028abba506) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:41:22 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-f46950c9-12bb-410f-ad1b-93ec46af28b2 tempest-VolumesActionsTest-931794454 None] Created volume successfully. Jul 17 19:41:22 devstack sudo[93178]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3e0833be-a11a-44c0-a409-4116484584a3 1073741824" returned: 0 in 0.470s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3e0833be-a11a-44c0-a409-4116484584a3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:22 devstack sudo[93184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3e0833be-a11a-44c0-a409-4116484584a3 Jul 17 19:41:22 devstack sudo[93184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-84d4e10a-86fe-43ba-a04e-6974f46e1236 tempest-VolumesActionsTest-902439597 None] Acquiring lock "cinder-7864f21d-2232-4764-8d01-988464309a41-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:41:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-84d4e10a-86fe-43ba-a04e-6974f46e1236 tempest-VolumesActionsTest-902439597 None] Lock "cinder-7864f21d-2232-4764-8d01-988464309a41-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:41:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-84d4e10a-86fe-43ba-a04e-6974f46e1236 tempest-VolumesActionsTest-902439597 None] Acquiring lock "cinder-quobyte-7864f21d-2232-4764-8d01-988464309a41" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:41:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-84d4e10a-86fe-43ba-a04e-6974f46e1236 tempest-VolumesActionsTest-902439597 None] Lock "cinder-quobyte-7864f21d-2232-4764-8d01-988464309a41" acquired by "delete_volume" :: waited 0.015s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:41:22 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8a01c2-85ff-42d2-acb7-e61aff96507c]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:41:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-84d4e10a-86fe-43ba-a04e-6974f46e1236 tempest-VolumesActionsTest-902439597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7864f21d-2232-4764-8d01-988464309a41 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:22 devstack sudo[93184]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3e0833be-a11a-44c0-a409-4116484584a3" returned: 0 in 0.276s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:41:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67fad8d0-49bc-45f6-96c1-6ff225a11219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e0833be-a11a-44c0-a409-4116484584a3', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fda2bb19-6ea8-442f-9d1e-980b6e7b42fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:22 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] Volume volume-3e0833be-a11a-44c0-a409-4116484584a3 (3e0833be-a11a-44c0-a409-4116484584a3): created successfully Jul 17 19:41:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fda2bb19-6ea8-442f-9d1e-980b6e7b42fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:22 devstack sudo[93186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7864f21d-2232-4764-8d01-988464309a41 Jul 17 19:41:22 devstack sudo[93186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] Flow 'volume_create_manager' (f711c5c5-1908-46a9-a385-9c32ff9c737f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:41:22 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-fb92e934-144e-4cd1-9b2b-98d7ddf6aaea tempest-ServersNegativeTestJSON-2123190462 None] Created volume successfully. Jul 17 19:41:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-06d874dc-c5ad-494a-a1b7-af3ccad1f8fd tempest-GroupsV314Test-255385181 None] Acquiring lock "cinder-quobyte-698f294c-d0ce-4216-ab9a-c1793c4b6a13" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:41:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-06d874dc-c5ad-494a-a1b7-af3ccad1f8fd tempest-GroupsV314Test-255385181 None] Lock "cinder-quobyte-698f294c-d0ce-4216-ab9a-c1793c4b6a13" acquired by "delete_volume" :: waited 0.023s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:41:23 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33c70b5-53f4-4df0-a493-2593755d7453]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:41:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-06d874dc-c5ad-494a-a1b7-af3ccad1f8fd tempest-GroupsV314Test-255385181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-698f294c-d0ce-4216-ab9a-c1793c4b6a13 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:23 devstack sudo[93186]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-84d4e10a-86fe-43ba-a04e-6974f46e1236 tempest-VolumesActionsTest-902439597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7864f21d-2232-4764-8d01-988464309a41" returned: 0 in 0.418s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-84d4e10a-86fe-43ba-a04e-6974f46e1236 tempest-VolumesActionsTest-902439597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7864f21d-2232-4764-8d01-988464309a41 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:23 devstack sudo[93189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-698f294c-d0ce-4216-ab9a-c1793c4b6a13 Jul 17 19:41:23 devstack sudo[93189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:23 devstack sudo[93193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7864f21d-2232-4764-8d01-988464309a41 Jul 17 19:41:23 devstack sudo[93193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:23 devstack sudo[93189]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-06d874dc-c5ad-494a-a1b7-af3ccad1f8fd tempest-GroupsV314Test-255385181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-698f294c-d0ce-4216-ab9a-c1793c4b6a13" returned: 0 in 0.372s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-06d874dc-c5ad-494a-a1b7-af3ccad1f8fd tempest-GroupsV314Test-255385181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-698f294c-d0ce-4216-ab9a-c1793c4b6a13 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:23 devstack sudo[93193]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-84d4e10a-86fe-43ba-a04e-6974f46e1236 tempest-VolumesActionsTest-902439597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7864f21d-2232-4764-8d01-988464309a41" returned: 0 in 0.265s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-84d4e10a-86fe-43ba-a04e-6974f46e1236 tempest-VolumesActionsTest-902439597 None] Lock "cinder-quobyte-7864f21d-2232-4764-8d01-988464309a41" released by "delete_volume" :: held 0.725s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:41:23 devstack sudo[93200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-698f294c-d0ce-4216-ab9a-c1793c4b6a13 Jul 17 19:41:23 devstack sudo[93200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:23 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-84d4e10a-86fe-43ba-a04e-6974f46e1236 tempest-VolumesActionsTest-902439597 None] Created reservations ['cfe195a7-f129-43c6-89a6-849f1c92bbc1', 'f5090880-64fa-4d62-8bfc-992400b9229f', 'fc39f7fe-e484-4271-925c-bd2b43e48596', 'd59e31e7-add6-49c7-a7ae-e32fddb1b3f9'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:41:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-84d4e10a-86fe-43ba-a04e-6974f46e1236 tempest-VolumesActionsTest-902439597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-84d4e10a-86fe-43ba-a04e-6974f46e1236 tempest-VolumesActionsTest-902439597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-84d4e10a-86fe-43ba-a04e-6974f46e1236 tempest-VolumesActionsTest-902439597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:41:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-84d4e10a-86fe-43ba-a04e-6974f46e1236 tempest-VolumesActionsTest-902439597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:41:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-84d4e10a-86fe-43ba-a04e-6974f46e1236 tempest-VolumesActionsTest-902439597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-84d4e10a-86fe-43ba-a04e-6974f46e1236 tempest-VolumesActionsTest-902439597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:23 devstack sudo[93202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:41:23 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:23 devstack sudo[93200]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-06d874dc-c5ad-494a-a1b7-af3ccad1f8fd tempest-GroupsV314Test-255385181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-698f294c-d0ce-4216-ab9a-c1793c4b6a13" returned: 0 in 0.263s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-06d874dc-c5ad-494a-a1b7-af3ccad1f8fd tempest-GroupsV314Test-255385181 None] Lock "cinder-quobyte-698f294c-d0ce-4216-ab9a-c1793c4b6a13" released by "delete_volume" :: held 0.678s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:41:23 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-06d874dc-c5ad-494a-a1b7-af3ccad1f8fd tempest-GroupsV314Test-255385181 None] Created reservations ['5a631224-be63-44b3-be76-7afe876c84a2'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:41:23 devstack cinder-volume[87726]: WARNING cinder.quota [None req-06d874dc-c5ad-494a-a1b7-af3ccad1f8fd tempest-GroupsV314Test-255385181 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-52332820 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-52332820, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:41:23 devstack cinder-volume[87726]: WARNING cinder.quota [None req-06d874dc-c5ad-494a-a1b7-af3ccad1f8fd tempest-GroupsV314Test-255385181 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-52332820 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-52332820, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:41:23 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-84d4e10a-86fe-43ba-a04e-6974f46e1236 tempest-VolumesActionsTest-902439597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.264s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:23 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-84d4e10a-86fe-43ba-a04e-6974f46e1236 tempest-VolumesActionsTest-902439597 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:41:23 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-84d4e10a-86fe-43ba-a04e-6974f46e1236 tempest-VolumesActionsTest-902439597 None] Deleted volume successfully. Jul 17 19:41:23 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-06d874dc-c5ad-494a-a1b7-af3ccad1f8fd tempest-GroupsV314Test-255385181 None] Created reservations ['3b6882fd-8036-48a9-8217-690c73d9daaf', '1f3eddfc-641f-4bf6-93cc-260cba8e4f9d', '3c770869-7dbe-4e1b-8c7c-351a7c9189d3', '642e3b2f-5e0c-4d51-b719-d969aeea104c'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:41:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-84d4e10a-86fe-43ba-a04e-6974f46e1236 tempest-VolumesActionsTest-902439597 None] Lock "cinder-7864f21d-2232-4764-8d01-988464309a41-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:41:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-06d874dc-c5ad-494a-a1b7-af3ccad1f8fd tempest-GroupsV314Test-255385181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-06d874dc-c5ad-494a-a1b7-af3ccad1f8fd tempest-GroupsV314Test-255385181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-06d874dc-c5ad-494a-a1b7-af3ccad1f8fd tempest-GroupsV314Test-255385181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:41:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-06d874dc-c5ad-494a-a1b7-af3ccad1f8fd tempest-GroupsV314Test-255385181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:41:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-06d874dc-c5ad-494a-a1b7-af3ccad1f8fd tempest-GroupsV314Test-255385181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-06d874dc-c5ad-494a-a1b7-af3ccad1f8fd tempest-GroupsV314Test-255385181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:23 devstack sudo[93206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:41:23 devstack sudo[93206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:24 devstack sudo[93206]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-06d874dc-c5ad-494a-a1b7-af3ccad1f8fd tempest-GroupsV314Test-255385181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.330s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:24 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-06d874dc-c5ad-494a-a1b7-af3ccad1f8fd tempest-GroupsV314Test-255385181 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:41:24 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-06d874dc-c5ad-494a-a1b7-af3ccad1f8fd tempest-GroupsV314Test-255385181 None] Delete group completed successfully. Jul 17 19:41:24 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:41:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] Flow 'volume_create_manager' (83e41671-f170-4b28-97bc-b284514e0905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:41:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81021341-5605-4480-83a3-4ecb880d965d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81021341-5605-4480-83a3-4ecb880d965d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-640671607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bccf070-1a02-4a3e-bd47-997e9911c226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15efb592bb14fac8540a5138f6ac99a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:41:24Z,use_quota=True,user_id='45025165f8214136a15334c0f5b629cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6574cd65-f346-46be-afb3-37fdaed8d3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6574cd65-f346-46be-afb3-37fdaed8d3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14b7a749-a534-4edb-b46b-cd32f9477d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14b7a749-a534-4edb-b46b-cd32f9477d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bccf070-1a02-4a3e-bd47-997e9911c226', 'volume_name': 'volume-2bccf070-1a02-4a3e-bd47-997e9911c226', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46191d6f-0ec3-4910-80d7-defe4b661b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46191d6f-0ec3-4910-80d7-defe4b661b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ccd74f-c0ac-46c4-af9e-e1f568b24b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:24 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] Volume 2bccf070-1a02-4a3e-bd47-997e9911c226: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bccf070-1a02-4a3e-bd47-997e9911c226', 'volume_size': 1} Jul 17 19:41:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-640671607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bccf070-1a02-4a3e-bd47-997e9911c226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15efb592bb14fac8540a5138f6ac99a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:41:24Z,use_quota=True,user_id='45025165f8214136a15334c0f5b629cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:41:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] Creating volume 2bccf070-1a02-4a3e-bd47-997e9911c226 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:41:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:41:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:41:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:41:24 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:41:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2bccf070-1a02-4a3e-bd47-997e9911c226 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:24 devstack sudo[93209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2bccf070-1a02-4a3e-bd47-997e9911c226 1073741824 Jul 17 19:41:24 devstack sudo[93209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:24 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-13ccb017-c945-4aed-9f22-84fb60d6ac69 tempest-GroupsV314Test-255385181 None] Acquiring lock "cinder-quobyte-cef08fb0-2194-4d9d-a123-da9ddccfd450" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:41:24 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-13ccb017-c945-4aed-9f22-84fb60d6ac69 tempest-GroupsV314Test-255385181 None] Lock "cinder-quobyte-cef08fb0-2194-4d9d-a123-da9ddccfd450" acquired by "delete_volume" :: waited 0.042s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:41:24 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[206ae9a7-4eda-49b3-8cc3-759889501e91]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:41:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-13ccb017-c945-4aed-9f22-84fb60d6ac69 tempest-GroupsV314Test-255385181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:24 devstack sudo[93211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450 Jul 17 19:41:24 devstack sudo[93211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:25 devstack sudo[93209]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2bccf070-1a02-4a3e-bd47-997e9911c226 1073741824" returned: 0 in 0.520s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:25 devstack sudo[93211]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-13ccb017-c945-4aed-9f22-84fb60d6ac69 tempest-GroupsV314Test-255385181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450" returned: 0 in 0.397s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-13ccb017-c945-4aed-9f22-84fb60d6ac69 tempest-GroupsV314Test-255385181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2bccf070-1a02-4a3e-bd47-997e9911c226 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:25 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450 Jul 17 19:41:25 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:25 devstack sudo[93221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2bccf070-1a02-4a3e-bd47-997e9911c226 Jul 17 19:41:25 devstack sudo[93221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:25 devstack sudo[93221]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:25 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2bccf070-1a02-4a3e-bd47-997e9911c226" returned: 0 in 0.286s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-13ccb017-c945-4aed-9f22-84fb60d6ac69 tempest-GroupsV314Test-255385181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cef08fb0-2194-4d9d-a123-da9ddccfd450" returned: 0 in 0.315s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ccd74f-c0ac-46c4-af9e-e1f568b24b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bccf070-1a02-4a3e-bd47-997e9911c226', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597a1e87-2eab-4426-b7bb-c75b88e4cfc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-13ccb017-c945-4aed-9f22-84fb60d6ac69 tempest-GroupsV314Test-255385181 None] Lock "cinder-quobyte-cef08fb0-2194-4d9d-a123-da9ddccfd450" released by "delete_volume" :: held 0.809s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:41:25 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] Volume volume-2bccf070-1a02-4a3e-bd47-997e9911c226 (2bccf070-1a02-4a3e-bd47-997e9911c226): created successfully Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597a1e87-2eab-4426-b7bb-c75b88e4cfc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] Flow 'volume_create_manager' (83e41671-f170-4b28-97bc-b284514e0905) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:41:25 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e532cd90-dc10-481e-b6f9-3b39c4f770df tempest-VolumesActionsTest-931794454 None] Created volume successfully. Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-13ccb017-c945-4aed-9f22-84fb60d6ac69 tempest-GroupsV314Test-255385181 None] Created reservations ['e08b9c13-188c-420f-9fe4-1d16af7784c1'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-13ccb017-c945-4aed-9f22-84fb60d6ac69 tempest-GroupsV314Test-255385181 None] Created reservations ['e7e1f71e-ded8-40f3-8833-6876dd30e8f3', '6084e9f8-dedf-4035-8d4d-bf01163efdd2', 'fc8e42c9-f30a-4dc8-ad19-cc90d2d42b14', 'a1c262bc-6820-4348-9403-b7bf9c9fe9dc'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-13ccb017-c945-4aed-9f22-84fb60d6ac69 tempest-GroupsV314Test-255385181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-13ccb017-c945-4aed-9f22-84fb60d6ac69 tempest-GroupsV314Test-255385181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-13ccb017-c945-4aed-9f22-84fb60d6ac69 tempest-GroupsV314Test-255385181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-13ccb017-c945-4aed-9f22-84fb60d6ac69 tempest-GroupsV314Test-255385181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-13ccb017-c945-4aed-9f22-84fb60d6ac69 tempest-GroupsV314Test-255385181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-13ccb017-c945-4aed-9f22-84fb60d6ac69 tempest-GroupsV314Test-255385181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:25 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:41:25 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] Flow 'volume_create_manager' (1150a116-182c-4583-8ba7-a78b45d1c12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20c105a2-0528-4811-ad3a-50d2bf3b4b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:25 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20c105a2-0528-4811-ad3a-50d2bf3b4b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1651838565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f722cb42-b9b0-4e2b-aaf0-a315c263231f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108acca2d75643a3a27efed93eb8712c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:41:26Z,use_quota=True,user_id='2e1d493e8d184418be2f4d64ca331aa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec2a65c-d15b-4602-8045-4d105bcf2dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec2a65c-d15b-4602-8045-4d105bcf2dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0c7f2b-919e-4e17-8cc1-e66a5201bfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0c7f2b-919e-4e17-8cc1-e66a5201bfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f722cb42-b9b0-4e2b-aaf0-a315c263231f', 'volume_name': 'volume-f722cb42-b9b0-4e2b-aaf0-a315c263231f', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7109762-e5f5-4bcc-9001-329dddda85ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7109762-e5f5-4bcc-9001-329dddda85ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06cb1de7-488e-4b9f-850e-57b45dd4ae82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:25 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] Volume f722cb42-b9b0-4e2b-aaf0-a315c263231f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f722cb42-b9b0-4e2b-aaf0-a315c263231f', 'volume_size': 1} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1651838565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f722cb42-b9b0-4e2b-aaf0-a315c263231f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108acca2d75643a3a27efed93eb8712c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:41:26Z,use_quota=True,user_id='2e1d493e8d184418be2f4d64ca331aa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] Creating volume f722cb42-b9b0-4e2b-aaf0-a315c263231f {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:41:25 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f722cb42-b9b0-4e2b-aaf0-a315c263231f 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-13ccb017-c945-4aed-9f22-84fb60d6ac69 tempest-GroupsV314Test-255385181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.327s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:25 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-13ccb017-c945-4aed-9f22-84fb60d6ac69 tempest-GroupsV314Test-255385181 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:41:25 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-13ccb017-c945-4aed-9f22-84fb60d6ac69 tempest-GroupsV314Test-255385181 None] Delete group completed successfully. Jul 17 19:41:25 devstack sudo[93229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f722cb42-b9b0-4e2b-aaf0-a315c263231f 1073741824 Jul 17 19:41:25 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:26 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f722cb42-b9b0-4e2b-aaf0-a315c263231f 1073741824" returned: 0 in 0.450s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f722cb42-b9b0-4e2b-aaf0-a315c263231f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:26 devstack sudo[93235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f722cb42-b9b0-4e2b-aaf0-a315c263231f Jul 17 19:41:26 devstack sudo[93235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-8b4295fd-9ffa-41be-9dc0-1122f78d4912 tempest-VolumesActionsTest-902439597 None] Acquiring lock "cinder-2bccf070-1a02-4a3e-bd47-997e9911c226-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:41:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-8b4295fd-9ffa-41be-9dc0-1122f78d4912 tempest-VolumesActionsTest-902439597 None] Lock "cinder-2bccf070-1a02-4a3e-bd47-997e9911c226-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:41:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-8b4295fd-9ffa-41be-9dc0-1122f78d4912 tempest-VolumesActionsTest-902439597 None] Acquiring lock "cinder-quobyte-2bccf070-1a02-4a3e-bd47-997e9911c226" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:41:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-8b4295fd-9ffa-41be-9dc0-1122f78d4912 tempest-VolumesActionsTest-902439597 None] Lock "cinder-quobyte-2bccf070-1a02-4a3e-bd47-997e9911c226" acquired by "delete_volume" :: waited 0.017s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:41:26 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[21547a47-1cbc-46f5-99fe-58d5a2bd7857]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:41:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8b4295fd-9ffa-41be-9dc0-1122f78d4912 tempest-VolumesActionsTest-902439597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2bccf070-1a02-4a3e-bd47-997e9911c226 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:26 devstack sudo[93235]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f722cb42-b9b0-4e2b-aaf0-a315c263231f" returned: 0 in 0.287s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:26 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:41:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06cb1de7-488e-4b9f-850e-57b45dd4ae82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f722cb42-b9b0-4e2b-aaf0-a315c263231f', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f4546b-2efa-408e-9a5d-525f98c8a9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:26 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] Volume volume-f722cb42-b9b0-4e2b-aaf0-a315c263231f (f722cb42-b9b0-4e2b-aaf0-a315c263231f): created successfully Jul 17 19:41:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f4546b-2efa-408e-9a5d-525f98c8a9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] Flow 'volume_create_manager' (1150a116-182c-4583-8ba7-a78b45d1c12b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:41:26 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-3ac40b70-e513-4234-91de-b561ab38067a tempest-ServersNegativeTestJSON-2123190462 None] Created volume successfully. Jul 17 19:41:26 devstack sudo[93238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2bccf070-1a02-4a3e-bd47-997e9911c226 Jul 17 19:41:26 devstack sudo[93238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:27 devstack sudo[93238]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8b4295fd-9ffa-41be-9dc0-1122f78d4912 tempest-VolumesActionsTest-902439597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2bccf070-1a02-4a3e-bd47-997e9911c226" returned: 0 in 0.401s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8b4295fd-9ffa-41be-9dc0-1122f78d4912 tempest-VolumesActionsTest-902439597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2bccf070-1a02-4a3e-bd47-997e9911c226 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:27 devstack sudo[93243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2bccf070-1a02-4a3e-bd47-997e9911c226 Jul 17 19:41:27 devstack sudo[93243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:27 devstack sudo[93243]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8b4295fd-9ffa-41be-9dc0-1122f78d4912 tempest-VolumesActionsTest-902439597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2bccf070-1a02-4a3e-bd47-997e9911c226" returned: 0 in 0.280s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-8b4295fd-9ffa-41be-9dc0-1122f78d4912 tempest-VolumesActionsTest-902439597 None] Lock "cinder-quobyte-2bccf070-1a02-4a3e-bd47-997e9911c226" released by "delete_volume" :: held 0.727s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:41:27 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-8b4295fd-9ffa-41be-9dc0-1122f78d4912 tempest-VolumesActionsTest-902439597 None] Created reservations ['d8b2296f-fef7-4505-bb56-99bbb603af8f', '236adff0-7444-42c7-b8d0-e34fe71e88a7', '7acd3d91-5f9a-4a2c-b673-5ddb1eba1087', 'e9aea641-3d1d-4b7f-9f2c-6136fbdcf072'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:41:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8b4295fd-9ffa-41be-9dc0-1122f78d4912 tempest-VolumesActionsTest-902439597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8b4295fd-9ffa-41be-9dc0-1122f78d4912 tempest-VolumesActionsTest-902439597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:27 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8b4295fd-9ffa-41be-9dc0-1122f78d4912 tempest-VolumesActionsTest-902439597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:41:27 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8b4295fd-9ffa-41be-9dc0-1122f78d4912 tempest-VolumesActionsTest-902439597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:41:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8b4295fd-9ffa-41be-9dc0-1122f78d4912 tempest-VolumesActionsTest-902439597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8b4295fd-9ffa-41be-9dc0-1122f78d4912 tempest-VolumesActionsTest-902439597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:27 devstack sudo[93247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:41:27 devstack sudo[93247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:27 devstack sudo[93247]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8b4295fd-9ffa-41be-9dc0-1122f78d4912 tempest-VolumesActionsTest-902439597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.282s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:27 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-8b4295fd-9ffa-41be-9dc0-1122f78d4912 tempest-VolumesActionsTest-902439597 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:41:27 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-8b4295fd-9ffa-41be-9dc0-1122f78d4912 tempest-VolumesActionsTest-902439597 None] Deleted volume successfully. Jul 17 19:41:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-8b4295fd-9ffa-41be-9dc0-1122f78d4912 tempest-VolumesActionsTest-902439597 None] Lock "cinder-2bccf070-1a02-4a3e-bd47-997e9911c226-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:41:28 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=95,cinder:INSERT=22,cinder:UPDATE=105,cinder:DELETE=4 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:41:28 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:UPDATE=107,cinder:SELECT=90,cinder:DELETE=8,cinder:INSERT=26 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:41:28 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:41:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] Flow 'volume_create_manager' (76c422d0-03e3-4a85-bb8b-717c9c0d64a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:41:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56417219-aec7-4ce3-9b54-92ea49229fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56417219-aec7-4ce3-9b54-92ea49229fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-730020974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84659595-68b7-47b1-bb25-8f5f24f415c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15efb592bb14fac8540a5138f6ac99a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:41:28Z,use_quota=True,user_id='45025165f8214136a15334c0f5b629cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d656d962-bef9-4b4c-b7f8-cc55a00d5d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d656d962-bef9-4b4c-b7f8-cc55a00d5d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (292c5108-ff39-4aca-a282-9d99ef28ae62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (292c5108-ff39-4aca-a282-9d99ef28ae62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84659595-68b7-47b1-bb25-8f5f24f415c9', 'volume_name': 'volume-84659595-68b7-47b1-bb25-8f5f24f415c9', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e35295b7-fa58-48ae-a80a-bf0e32328ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e35295b7-fa58-48ae-a80a-bf0e32328ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a022540-9a6d-45b7-9d03-95b2a66be32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:28 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] Volume 84659595-68b7-47b1-bb25-8f5f24f415c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84659595-68b7-47b1-bb25-8f5f24f415c9', 'volume_size': 1} Jul 17 19:41:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-730020974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84659595-68b7-47b1-bb25-8f5f24f415c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15efb592bb14fac8540a5138f6ac99a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:41:28Z,use_quota=True,user_id='45025165f8214136a15334c0f5b629cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:41:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] Creating volume 84659595-68b7-47b1-bb25-8f5f24f415c9 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:41:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:41:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:41:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:41:28 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:41:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84659595-68b7-47b1-bb25-8f5f24f415c9 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:28 devstack sudo[93250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84659595-68b7-47b1-bb25-8f5f24f415c9 1073741824 Jul 17 19:41:28 devstack sudo[93250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-672378d6-edb6-4eec-8df4-88dba6905663 tempest-ServersNegativeTestJSON-2123190462 None] Acquiring lock "cinder-f722cb42-b9b0-4e2b-aaf0-a315c263231f-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:41:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-672378d6-edb6-4eec-8df4-88dba6905663 tempest-ServersNegativeTestJSON-2123190462 None] Lock "cinder-f722cb42-b9b0-4e2b-aaf0-a315c263231f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:41:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-672378d6-edb6-4eec-8df4-88dba6905663 tempest-ServersNegativeTestJSON-2123190462 None] Acquiring lock "cinder-quobyte-f722cb42-b9b0-4e2b-aaf0-a315c263231f" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:41:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-672378d6-edb6-4eec-8df4-88dba6905663 tempest-ServersNegativeTestJSON-2123190462 None] Lock "cinder-quobyte-f722cb42-b9b0-4e2b-aaf0-a315c263231f" acquired by "delete_volume" :: waited 0.016s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:41:28 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[614e6d8b-d98b-4202-9722-bf6caa63da38]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:41:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-672378d6-edb6-4eec-8df4-88dba6905663 tempest-ServersNegativeTestJSON-2123190462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f722cb42-b9b0-4e2b-aaf0-a315c263231f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:28 devstack sudo[93255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f722cb42-b9b0-4e2b-aaf0-a315c263231f Jul 17 19:41:28 devstack sudo[93255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:29 devstack sudo[93250]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84659595-68b7-47b1-bb25-8f5f24f415c9 1073741824" returned: 0 in 0.516s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84659595-68b7-47b1-bb25-8f5f24f415c9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:29 devstack sudo[93258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84659595-68b7-47b1-bb25-8f5f24f415c9 Jul 17 19:41:29 devstack sudo[93258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:29 devstack sudo[93255]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-672378d6-edb6-4eec-8df4-88dba6905663 tempest-ServersNegativeTestJSON-2123190462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f722cb42-b9b0-4e2b-aaf0-a315c263231f" returned: 0 in 0.393s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-672378d6-edb6-4eec-8df4-88dba6905663 tempest-ServersNegativeTestJSON-2123190462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f722cb42-b9b0-4e2b-aaf0-a315c263231f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:29 devstack sudo[93263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f722cb42-b9b0-4e2b-aaf0-a315c263231f Jul 17 19:41:29 devstack sudo[93263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:29 devstack sudo[93258]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84659595-68b7-47b1-bb25-8f5f24f415c9" returned: 0 in 0.287s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:29 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:41:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:29 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a022540-9a6d-45b7-9d03-95b2a66be32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84659595-68b7-47b1-bb25-8f5f24f415c9', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:29 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ea4b95-903b-4674-b6e5-7eefed205127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:29 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] Volume volume-84659595-68b7-47b1-bb25-8f5f24f415c9 (84659595-68b7-47b1-bb25-8f5f24f415c9): created successfully Jul 17 19:41:29 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ea4b95-903b-4674-b6e5-7eefed205127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:29 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] Flow 'volume_create_manager' (76c422d0-03e3-4a85-bb8b-717c9c0d64a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:41:29 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-8283026b-ddcc-49ea-99d7-a2fd86628509 tempest-VolumesActionsTest-931794454 None] Created volume successfully. Jul 17 19:41:29 devstack sudo[93263]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-672378d6-edb6-4eec-8df4-88dba6905663 tempest-ServersNegativeTestJSON-2123190462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f722cb42-b9b0-4e2b-aaf0-a315c263231f" returned: 0 in 0.269s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-672378d6-edb6-4eec-8df4-88dba6905663 tempest-ServersNegativeTestJSON-2123190462 None] Lock "cinder-quobyte-f722cb42-b9b0-4e2b-aaf0-a315c263231f" released by "delete_volume" :: held 0.705s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:41:29 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-672378d6-edb6-4eec-8df4-88dba6905663 tempest-ServersNegativeTestJSON-2123190462 None] Created reservations ['67f1af00-3de3-4823-a2cc-31e07ec0a2eb', '012e2d10-fa84-407f-99fb-89e591ab2490', 'ca043c93-430e-4302-8197-203bbf1435e5', '652dcf85-1d94-45f6-b370-c0157e127b29'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:41:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-672378d6-edb6-4eec-8df4-88dba6905663 tempest-ServersNegativeTestJSON-2123190462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-672378d6-edb6-4eec-8df4-88dba6905663 tempest-ServersNegativeTestJSON-2123190462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:29 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-672378d6-edb6-4eec-8df4-88dba6905663 tempest-ServersNegativeTestJSON-2123190462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:41:29 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-672378d6-edb6-4eec-8df4-88dba6905663 tempest-ServersNegativeTestJSON-2123190462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:41:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-672378d6-edb6-4eec-8df4-88dba6905663 tempest-ServersNegativeTestJSON-2123190462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-672378d6-edb6-4eec-8df4-88dba6905663 tempest-ServersNegativeTestJSON-2123190462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:29 devstack sudo[93268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:41:29 devstack sudo[93268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c25c265a-7e6a-49aa-b304-f9318c05823d tempest-ServersNegativeTestJSON-2123190462 None] Acquiring lock "cinder-3e0833be-a11a-44c0-a409-4116484584a3-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:41:29 devstack sudo[93268]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-672378d6-edb6-4eec-8df4-88dba6905663 tempest-ServersNegativeTestJSON-2123190462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.261s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:29 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-672378d6-edb6-4eec-8df4-88dba6905663 tempest-ServersNegativeTestJSON-2123190462 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:41:29 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-672378d6-edb6-4eec-8df4-88dba6905663 tempest-ServersNegativeTestJSON-2123190462 None] Deleted volume successfully. Jul 17 19:41:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c25c265a-7e6a-49aa-b304-f9318c05823d tempest-ServersNegativeTestJSON-2123190462 None] Lock "cinder-3e0833be-a11a-44c0-a409-4116484584a3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:41:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-672378d6-edb6-4eec-8df4-88dba6905663 tempest-ServersNegativeTestJSON-2123190462 None] Lock "cinder-f722cb42-b9b0-4e2b-aaf0-a315c263231f-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:41:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c25c265a-7e6a-49aa-b304-f9318c05823d tempest-ServersNegativeTestJSON-2123190462 None] Acquiring lock "cinder-quobyte-3e0833be-a11a-44c0-a409-4116484584a3" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:41:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c25c265a-7e6a-49aa-b304-f9318c05823d tempest-ServersNegativeTestJSON-2123190462 None] Lock "cinder-quobyte-3e0833be-a11a-44c0-a409-4116484584a3" acquired by "delete_volume" :: waited 0.017s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:41:29 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81cd75f-33f4-433a-828c-6421b35752a8]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:41:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c25c265a-7e6a-49aa-b304-f9318c05823d tempest-ServersNegativeTestJSON-2123190462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3e0833be-a11a-44c0-a409-4116484584a3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:30 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3e0833be-a11a-44c0-a409-4116484584a3 Jul 17 19:41:30 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:30 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c25c265a-7e6a-49aa-b304-f9318c05823d tempest-ServersNegativeTestJSON-2123190462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3e0833be-a11a-44c0-a409-4116484584a3" returned: 0 in 0.395s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c25c265a-7e6a-49aa-b304-f9318c05823d tempest-ServersNegativeTestJSON-2123190462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3e0833be-a11a-44c0-a409-4116484584a3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:30 devstack sudo[93276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3e0833be-a11a-44c0-a409-4116484584a3 Jul 17 19:41:30 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:30 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ba23d554-c8db-46c2-8ff5-fcfe08065fc5 tempest-VolumesActionsTest-902439597 None] Acquiring lock "cinder-84659595-68b7-47b1-bb25-8f5f24f415c9-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:41:30 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c25c265a-7e6a-49aa-b304-f9318c05823d tempest-ServersNegativeTestJSON-2123190462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3e0833be-a11a-44c0-a409-4116484584a3" returned: 0 in 0.271s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:30 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c25c265a-7e6a-49aa-b304-f9318c05823d tempest-ServersNegativeTestJSON-2123190462 None] Lock "cinder-quobyte-3e0833be-a11a-44c0-a409-4116484584a3" released by "delete_volume" :: held 0.715s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:41:30 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ba23d554-c8db-46c2-8ff5-fcfe08065fc5 tempest-VolumesActionsTest-902439597 None] Lock "cinder-84659595-68b7-47b1-bb25-8f5f24f415c9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:41:30 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ba23d554-c8db-46c2-8ff5-fcfe08065fc5 tempest-VolumesActionsTest-902439597 None] Acquiring lock "cinder-quobyte-84659595-68b7-47b1-bb25-8f5f24f415c9" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:41:30 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ba23d554-c8db-46c2-8ff5-fcfe08065fc5 tempest-VolumesActionsTest-902439597 None] Lock "cinder-quobyte-84659595-68b7-47b1-bb25-8f5f24f415c9" acquired by "delete_volume" :: waited 0.023s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:41:30 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-c25c265a-7e6a-49aa-b304-f9318c05823d tempest-ServersNegativeTestJSON-2123190462 None] Created reservations ['99d6301c-1ecc-446b-885a-f42d67b7366b', 'a26329ab-4eed-4b5a-a89c-0b4671b243ff', '7e42ccbe-d4e1-4714-bc15-261e10697cad', 'd246c513-55d2-4b68-8a00-966eaa4c95ed'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:41:30 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[0965569c-3df0-4342-a777-4590f58f791a]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:41:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ba23d554-c8db-46c2-8ff5-fcfe08065fc5 tempest-VolumesActionsTest-902439597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84659595-68b7-47b1-bb25-8f5f24f415c9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c25c265a-7e6a-49aa-b304-f9318c05823d tempest-ServersNegativeTestJSON-2123190462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c25c265a-7e6a-49aa-b304-f9318c05823d tempest-ServersNegativeTestJSON-2123190462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:30 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c25c265a-7e6a-49aa-b304-f9318c05823d tempest-ServersNegativeTestJSON-2123190462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:41:30 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c25c265a-7e6a-49aa-b304-f9318c05823d tempest-ServersNegativeTestJSON-2123190462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:41:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c25c265a-7e6a-49aa-b304-f9318c05823d tempest-ServersNegativeTestJSON-2123190462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c25c265a-7e6a-49aa-b304-f9318c05823d tempest-ServersNegativeTestJSON-2123190462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:30 devstack sudo[93282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:41:30 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:30 devstack sudo[93281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84659595-68b7-47b1-bb25-8f5f24f415c9 Jul 17 19:41:30 devstack sudo[93281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:31 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c25c265a-7e6a-49aa-b304-f9318c05823d tempest-ServersNegativeTestJSON-2123190462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.355s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:31 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-c25c265a-7e6a-49aa-b304-f9318c05823d tempest-ServersNegativeTestJSON-2123190462 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:41:31 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-c25c265a-7e6a-49aa-b304-f9318c05823d tempest-ServersNegativeTestJSON-2123190462 None] Deleted volume successfully. Jul 17 19:41:31 devstack sudo[93281]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:31 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c25c265a-7e6a-49aa-b304-f9318c05823d tempest-ServersNegativeTestJSON-2123190462 None] Lock "cinder-3e0833be-a11a-44c0-a409-4116484584a3-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:41:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ba23d554-c8db-46c2-8ff5-fcfe08065fc5 tempest-VolumesActionsTest-902439597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84659595-68b7-47b1-bb25-8f5f24f415c9" returned: 0 in 0.511s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ba23d554-c8db-46c2-8ff5-fcfe08065fc5 tempest-VolumesActionsTest-902439597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84659595-68b7-47b1-bb25-8f5f24f415c9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:31 devstack sudo[93289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84659595-68b7-47b1-bb25-8f5f24f415c9 Jul 17 19:41:31 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:31 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-00233160-2e9b-4382-b521-0883b39406ce tempest-GroupsV320Test-1733409957 None] Group tempest-GroupsV320Test-Group-1394157746: creating Jul 17 19:41:31 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-00233160-2e9b-4382-b521-0883b39406ce tempest-GroupsV320Test-1733409957 None] Group tempest-GroupsV320Test-Group-1394157746: created successfully Jul 17 19:41:31 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-00233160-2e9b-4382-b521-0883b39406ce tempest-GroupsV320Test-1733409957 None] Create group completed successfully. Jul 17 19:41:31 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ba23d554-c8db-46c2-8ff5-fcfe08065fc5 tempest-VolumesActionsTest-902439597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84659595-68b7-47b1-bb25-8f5f24f415c9" returned: 0 in 0.425s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:31 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ba23d554-c8db-46c2-8ff5-fcfe08065fc5 tempest-VolumesActionsTest-902439597 None] Lock "cinder-quobyte-84659595-68b7-47b1-bb25-8f5f24f415c9" released by "delete_volume" :: held 0.998s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:41:31 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-ba23d554-c8db-46c2-8ff5-fcfe08065fc5 tempest-VolumesActionsTest-902439597 None] Created reservations ['aa101e62-6397-4231-bee8-d3c0991fd18a', 'f354e14a-71a5-45b8-a27f-3607cff27aae', '2f60b1b1-1135-4120-8611-5c87d905d5a9', 'f671e80e-afbe-47ff-8429-2b0357195274'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:41:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ba23d554-c8db-46c2-8ff5-fcfe08065fc5 tempest-VolumesActionsTest-902439597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ba23d554-c8db-46c2-8ff5-fcfe08065fc5 tempest-VolumesActionsTest-902439597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ba23d554-c8db-46c2-8ff5-fcfe08065fc5 tempest-VolumesActionsTest-902439597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:41:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ba23d554-c8db-46c2-8ff5-fcfe08065fc5 tempest-VolumesActionsTest-902439597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:41:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ba23d554-c8db-46c2-8ff5-fcfe08065fc5 tempest-VolumesActionsTest-902439597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ba23d554-c8db-46c2-8ff5-fcfe08065fc5 tempest-VolumesActionsTest-902439597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:32 devstack sudo[93318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:41:32 devstack sudo[93318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:32 devstack sudo[93318]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ba23d554-c8db-46c2-8ff5-fcfe08065fc5 tempest-VolumesActionsTest-902439597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.438s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:32 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-ba23d554-c8db-46c2-8ff5-fcfe08065fc5 tempest-VolumesActionsTest-902439597 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:41:32 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-ba23d554-c8db-46c2-8ff5-fcfe08065fc5 tempest-VolumesActionsTest-902439597 None] Deleted volume successfully. Jul 17 19:41:32 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ba23d554-c8db-46c2-8ff5-fcfe08065fc5 tempest-VolumesActionsTest-902439597 None] Lock "cinder-84659595-68b7-47b1-bb25-8f5f24f415c9-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-5d5cc5dc-7aa8-41da-b151-fa64e44c879d tempest-GroupsV320Test-1733409957 None] Created reservations ['ec1d405b-5902-42bb-81b0-f5ac607b2407'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5d5cc5dc-7aa8-41da-b151-fa64e44c879d tempest-GroupsV320Test-1733409957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5d5cc5dc-7aa8-41da-b151-fa64e44c879d tempest-GroupsV320Test-1733409957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5d5cc5dc-7aa8-41da-b151-fa64e44c879d tempest-GroupsV320Test-1733409957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5d5cc5dc-7aa8-41da-b151-fa64e44c879d tempest-GroupsV320Test-1733409957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5d5cc5dc-7aa8-41da-b151-fa64e44c879d tempest-GroupsV320Test-1733409957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5d5cc5dc-7aa8-41da-b151-fa64e44c879d tempest-GroupsV320Test-1733409957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:33 devstack sudo[93339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:41:33 devstack sudo[93339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:33 devstack sudo[93339]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5d5cc5dc-7aa8-41da-b151-fa64e44c879d tempest-GroupsV320Test-1733409957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.280s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-5d5cc5dc-7aa8-41da-b151-fa64e44c879d tempest-GroupsV320Test-1733409957 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:41:33 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-5d5cc5dc-7aa8-41da-b151-fa64e44c879d tempest-GroupsV320Test-1733409957 None] Delete group completed successfully. Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] Flow 'volume_create_manager' (23d87755-50a8-4b67-aea5-eb9e6e34f1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fae1c8a-d9a7-40fd-9e62-9a6c5de7d844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fae1c8a-d9a7-40fd-9e62-9a6c5de7d844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1652352452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fce463ff-308a-4b07-ae82-4ed094789968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15efb592bb14fac8540a5138f6ac99a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:41:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:41:34Z,use_quota=True,user_id='45025165f8214136a15334c0f5b629cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d33da42-90ea-47fb-82e7-81d1a2fa53d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d33da42-90ea-47fb-82e7-81d1a2fa53d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24b93d6-1425-4bc6-8f9b-654ce5ac8db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24b93d6-1425-4bc6-8f9b-654ce5ac8db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fce463ff-308a-4b07-ae82-4ed094789968', 'volume_name': 'volume-fce463ff-308a-4b07-ae82-4ed094789968', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af12911f-f4b4-467f-b5cd-fb139d44bd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af12911f-f4b4-467f-b5cd-fb139d44bd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e77313ef-b3e7-421a-af49-cdc1b9bb97bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:33 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] Volume fce463ff-308a-4b07-ae82-4ed094789968: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fce463ff-308a-4b07-ae82-4ed094789968', 'volume_size': 1} Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1652352452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fce463ff-308a-4b07-ae82-4ed094789968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15efb592bb14fac8540a5138f6ac99a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:41:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:41:34Z,use_quota=True,user_id='45025165f8214136a15334c0f5b629cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] Creating volume fce463ff-308a-4b07-ae82-4ed094789968 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:41:33 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:41:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-fce463ff-308a-4b07-ae82-4ed094789968 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:33 devstack sudo[93343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-fce463ff-308a-4b07-ae82-4ed094789968 1073741824 Jul 17 19:41:33 devstack sudo[93343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:34 devstack sudo[93343]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-fce463ff-308a-4b07-ae82-4ed094789968 1073741824" returned: 0 in 0.571s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-fce463ff-308a-4b07-ae82-4ed094789968 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:34 devstack sudo[93350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-fce463ff-308a-4b07-ae82-4ed094789968 Jul 17 19:41:34 devstack sudo[93350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:34 devstack sudo[93350]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-fce463ff-308a-4b07-ae82-4ed094789968" returned: 0 in 0.376s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:34 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:41:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e77313ef-b3e7-421a-af49-cdc1b9bb97bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fce463ff-308a-4b07-ae82-4ed094789968', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b54775-7096-41e4-9588-247679c47d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:34 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] Volume volume-fce463ff-308a-4b07-ae82-4ed094789968 (fce463ff-308a-4b07-ae82-4ed094789968): created successfully Jul 17 19:41:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b54775-7096-41e4-9588-247679c47d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] Flow 'volume_create_manager' (23d87755-50a8-4b67-aea5-eb9e6e34f1b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:41:34 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-80782b69-b6f7-4f07-b736-da053b619b8a tempest-VolumesActionsTest-931794454 None] Created volume successfully. Jul 17 19:41:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0d7a2454-72d1-4421-9ee4-b83ed6f84aae tempest-VolumesActionsTest-931794454 None] Acquiring lock "cinder-fce463ff-308a-4b07-ae82-4ed094789968-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:41:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0d7a2454-72d1-4421-9ee4-b83ed6f84aae tempest-VolumesActionsTest-931794454 None] Lock "cinder-fce463ff-308a-4b07-ae82-4ed094789968-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:41:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0d7a2454-72d1-4421-9ee4-b83ed6f84aae tempest-VolumesActionsTest-931794454 None] Acquiring lock "cinder-quobyte-fce463ff-308a-4b07-ae82-4ed094789968" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:41:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0d7a2454-72d1-4421-9ee4-b83ed6f84aae tempest-VolumesActionsTest-931794454 None] Lock "cinder-quobyte-fce463ff-308a-4b07-ae82-4ed094789968" acquired by "delete_volume" :: waited 0.015s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:41:36 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[31957bcc-67be-4aac-9f3e-cdc2d762d55f]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:41:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0d7a2454-72d1-4421-9ee4-b83ed6f84aae tempest-VolumesActionsTest-931794454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-fce463ff-308a-4b07-ae82-4ed094789968 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:36 devstack sudo[93354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-fce463ff-308a-4b07-ae82-4ed094789968 Jul 17 19:41:36 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a5e219a7-5851-47f9-8a30-a84bdba91129 tempest-AttachVolumeShelveTestJSON-1029088150 None] Acquiring lock "cinder-f150c640-aeb4-41fa-a36f-22478d702d07-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:41:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a5e219a7-5851-47f9-8a30-a84bdba91129 tempest-AttachVolumeShelveTestJSON-1029088150 None] Lock "cinder-f150c640-aeb4-41fa-a36f-22478d702d07-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:41:37 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0d7a2454-72d1-4421-9ee4-b83ed6f84aae tempest-VolumesActionsTest-931794454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-fce463ff-308a-4b07-ae82-4ed094789968" returned: 0 in 0.495s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0d7a2454-72d1-4421-9ee4-b83ed6f84aae tempest-VolumesActionsTest-931794454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-fce463ff-308a-4b07-ae82-4ed094789968 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a5e219a7-5851-47f9-8a30-a84bdba91129 tempest-AttachVolumeShelveTestJSON-1029088150 None] Acquiring lock "cinder-quobyte-f150c640-aeb4-41fa-a36f-22478d702d07" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:41:37 devstack sudo[93359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-fce463ff-308a-4b07-ae82-4ed094789968 Jul 17 19:41:37 devstack sudo[93359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a5e219a7-5851-47f9-8a30-a84bdba91129 tempest-AttachVolumeShelveTestJSON-1029088150 None] Lock "cinder-quobyte-f150c640-aeb4-41fa-a36f-22478d702d07" acquired by "delete_volume" :: waited 0.033s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:41:37 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a5feed-bb76-4af9-b6c8-d43305d341cc]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:41:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a5e219a7-5851-47f9-8a30-a84bdba91129 tempest-AttachVolumeShelveTestJSON-1029088150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f150c640-aeb4-41fa-a36f-22478d702d07 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:37 devstack sudo[93361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f150c640-aeb4-41fa-a36f-22478d702d07 Jul 17 19:41:37 devstack sudo[93361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:37 devstack sudo[93359]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0d7a2454-72d1-4421-9ee4-b83ed6f84aae tempest-VolumesActionsTest-931794454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-fce463ff-308a-4b07-ae82-4ed094789968" returned: 0 in 0.379s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0d7a2454-72d1-4421-9ee4-b83ed6f84aae tempest-VolumesActionsTest-931794454 None] Lock "cinder-quobyte-fce463ff-308a-4b07-ae82-4ed094789968" released by "delete_volume" :: held 0.927s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:41:37 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-0d7a2454-72d1-4421-9ee4-b83ed6f84aae tempest-VolumesActionsTest-931794454 None] Created reservations ['51a5fd8c-295a-4e1c-b9ee-79d5bc8f030e', '53a4f794-ffaf-4818-82aa-6545c4d90bb9', '51af6e53-1e29-44c2-b337-8f2b657dc54e', 'ae964962-907e-448f-803c-f63a3c82f3c8'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:41:37 devstack sudo[93361]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a5e219a7-5851-47f9-8a30-a84bdba91129 tempest-AttachVolumeShelveTestJSON-1029088150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f150c640-aeb4-41fa-a36f-22478d702d07" returned: 0 in 0.485s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a5e219a7-5851-47f9-8a30-a84bdba91129 tempest-AttachVolumeShelveTestJSON-1029088150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f150c640-aeb4-41fa-a36f-22478d702d07 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0d7a2454-72d1-4421-9ee4-b83ed6f84aae tempest-VolumesActionsTest-931794454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0d7a2454-72d1-4421-9ee4-b83ed6f84aae tempest-VolumesActionsTest-931794454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0d7a2454-72d1-4421-9ee4-b83ed6f84aae tempest-VolumesActionsTest-931794454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:41:37 devstack sudo[93367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f150c640-aeb4-41fa-a36f-22478d702d07 Jul 17 19:41:37 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0d7a2454-72d1-4421-9ee4-b83ed6f84aae tempest-VolumesActionsTest-931794454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:41:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0d7a2454-72d1-4421-9ee4-b83ed6f84aae tempest-VolumesActionsTest-931794454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0d7a2454-72d1-4421-9ee4-b83ed6f84aae tempest-VolumesActionsTest-931794454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:37 devstack sudo[93369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:41:37 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:38 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a5e219a7-5851-47f9-8a30-a84bdba91129 tempest-AttachVolumeShelveTestJSON-1029088150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f150c640-aeb4-41fa-a36f-22478d702d07" returned: 0 in 0.351s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:38 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0d7a2454-72d1-4421-9ee4-b83ed6f84aae tempest-VolumesActionsTest-931794454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.322s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:38 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-0d7a2454-72d1-4421-9ee4-b83ed6f84aae tempest-VolumesActionsTest-931794454 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:41:38 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a5e219a7-5851-47f9-8a30-a84bdba91129 tempest-AttachVolumeShelveTestJSON-1029088150 None] Lock "cinder-quobyte-f150c640-aeb4-41fa-a36f-22478d702d07" released by "delete_volume" :: held 0.896s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:41:38 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-0d7a2454-72d1-4421-9ee4-b83ed6f84aae tempest-VolumesActionsTest-931794454 None] Deleted volume successfully. Jul 17 19:41:38 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0d7a2454-72d1-4421-9ee4-b83ed6f84aae tempest-VolumesActionsTest-931794454 None] Lock "cinder-fce463ff-308a-4b07-ae82-4ed094789968-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:41:38 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-a5e219a7-5851-47f9-8a30-a84bdba91129 tempest-AttachVolumeShelveTestJSON-1029088150 None] Created reservations ['63ad7e02-63b9-4138-a81f-b71e54f8b8ee', '04089a67-81aa-4ffc-b2ba-f02c5eda20c6', '2ffcce53-2b18-4bf8-bf31-5ed6b185fd81', '544f86d9-36c6-45aa-bbbd-8a0cc6ecfb2f'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:41:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a5e219a7-5851-47f9-8a30-a84bdba91129 tempest-AttachVolumeShelveTestJSON-1029088150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a5e219a7-5851-47f9-8a30-a84bdba91129 tempest-AttachVolumeShelveTestJSON-1029088150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:38 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a5e219a7-5851-47f9-8a30-a84bdba91129 tempest-AttachVolumeShelveTestJSON-1029088150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:41:38 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a5e219a7-5851-47f9-8a30-a84bdba91129 tempest-AttachVolumeShelveTestJSON-1029088150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:41:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a5e219a7-5851-47f9-8a30-a84bdba91129 tempest-AttachVolumeShelveTestJSON-1029088150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a5e219a7-5851-47f9-8a30-a84bdba91129 tempest-AttachVolumeShelveTestJSON-1029088150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:38 devstack sudo[93373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:41:38 devstack sudo[93373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:38 devstack sudo[93373]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a5e219a7-5851-47f9-8a30-a84bdba91129 tempest-AttachVolumeShelveTestJSON-1029088150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.277s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:38 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-a5e219a7-5851-47f9-8a30-a84bdba91129 tempest-AttachVolumeShelveTestJSON-1029088150 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:41:38 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-a5e219a7-5851-47f9-8a30-a84bdba91129 tempest-AttachVolumeShelveTestJSON-1029088150 None] Deleted volume successfully. Jul 17 19:41:38 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a5e219a7-5851-47f9-8a30-a84bdba91129 tempest-AttachVolumeShelveTestJSON-1029088150 None] Lock "cinder-f150c640-aeb4-41fa-a36f-22478d702d07-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:41:48 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=37,cinder:UPDATE=49,cinder:INSERT=6,cinder:DELETE=4 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:41:48 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:UPDATE=49,cinder:SELECT=33,cinder:INSERT=17,cinder:DELETE=3 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:41:54 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:41:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] Flow 'volume_create_manager' (d402d17b-0a5c-499c-ad35-4c746b196e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:41:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1897e16-8b1e-4e85-846c-c270d34db0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1897e16-8b1e-4e85-846c-c270d34db0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1515120995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=400ea139-60d0-4566-ac5c-c1a1420c3697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82f3ab6f19dc41f79d640adb05fe184c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:41:54Z,use_quota=True,user_id='40e3c01810594fb6baf44cf4183d45a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca11db2e-83a2-458d-9a6c-63b787008235),volume_type_id=ca11db2e-83a2-458d-9a6c-63b787008235)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3736db07-0cd4-4ee3-a96d-38a046c8baff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3736db07-0cd4-4ee3-a96d-38a046c8baff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c91e97-5039-496b-9ee4-6c42f8e18787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c91e97-5039-496b-9ee4-6c42f8e18787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '400ea139-60d0-4566-ac5c-c1a1420c3697', 'volume_name': 'volume-400ea139-60d0-4566-ac5c-c1a1420c3697', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742d26f6-3fb4-47c6-98f7-6dbac0b44136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742d26f6-3fb4-47c6-98f7-6dbac0b44136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54677de8-bd89-47a1-b9f9-47202b56476f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:54 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] Volume 400ea139-60d0-4566-ac5c-c1a1420c3697: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-400ea139-60d0-4566-ac5c-c1a1420c3697', 'volume_size': 1} Jul 17 19:41:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:54 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1515120995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=400ea139-60d0-4566-ac5c-c1a1420c3697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82f3ab6f19dc41f79d640adb05fe184c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:41:54Z,use_quota=True,user_id='40e3c01810594fb6baf44cf4183d45a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca11db2e-83a2-458d-9a6c-63b787008235),volume_type_id=ca11db2e-83a2-458d-9a6c-63b787008235)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:41:54 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] Creating volume 400ea139-60d0-4566-ac5c-c1a1420c3697 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:41:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:54 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:41:54 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:41:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:54 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:41:54 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:41:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-400ea139-60d0-4566-ac5c-c1a1420c3697 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:54 devstack sudo[93424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-400ea139-60d0-4566-ac5c-c1a1420c3697 1073741824 Jul 17 19:41:54 devstack sudo[93424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:55 devstack sudo[93424]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-400ea139-60d0-4566-ac5c-c1a1420c3697 1073741824" returned: 0 in 0.558s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-400ea139-60d0-4566-ac5c-c1a1420c3697 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:55 devstack sudo[93436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-400ea139-60d0-4566-ac5c-c1a1420c3697 Jul 17 19:41:55 devstack sudo[93436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:55 devstack sudo[93436]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-400ea139-60d0-4566-ac5c-c1a1420c3697" returned: 0 in 0.374s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:55 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:41:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54677de8-bd89-47a1-b9f9-47202b56476f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-400ea139-60d0-4566-ac5c-c1a1420c3697', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc14415c-3adc-469c-a122-10ec3b14fcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:55 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] Volume volume-400ea139-60d0-4566-ac5c-c1a1420c3697 (400ea139-60d0-4566-ac5c-c1a1420c3697): created successfully Jul 17 19:41:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc14415c-3adc-469c-a122-10ec3b14fcc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] Flow 'volume_create_manager' (d402d17b-0a5c-499c-ad35-4c746b196e9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:41:55 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-1b8502e9-3b95-4eb8-b23a-e8ec3793e0ff tempest-VolumeTypesAccessTest-547935671 None] Created volume successfully. Jul 17 19:41:56 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e8857cec-7b74-41fd-82dd-a9ad2cbec77a tempest-VolumeTypesAccessTest-547935671 None] Acquiring lock "cinder-400ea139-60d0-4566-ac5c-c1a1420c3697-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:41:56 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e8857cec-7b74-41fd-82dd-a9ad2cbec77a tempest-VolumeTypesAccessTest-547935671 None] Lock "cinder-400ea139-60d0-4566-ac5c-c1a1420c3697-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:41:56 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e8857cec-7b74-41fd-82dd-a9ad2cbec77a tempest-VolumeTypesAccessTest-547935671 None] Acquiring lock "cinder-quobyte-400ea139-60d0-4566-ac5c-c1a1420c3697" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:41:56 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e8857cec-7b74-41fd-82dd-a9ad2cbec77a tempest-VolumeTypesAccessTest-547935671 None] Lock "cinder-quobyte-400ea139-60d0-4566-ac5c-c1a1420c3697" acquired by "delete_volume" :: waited 0.014s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:41:56 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcba789-5442-4f4b-8534-e2d6720c95db]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:41:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e8857cec-7b74-41fd-82dd-a9ad2cbec77a tempest-VolumeTypesAccessTest-547935671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-400ea139-60d0-4566-ac5c-c1a1420c3697 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:57 devstack sudo[93439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-400ea139-60d0-4566-ac5c-c1a1420c3697 Jul 17 19:41:57 devstack sudo[93439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:57 devstack sudo[93439]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e8857cec-7b74-41fd-82dd-a9ad2cbec77a tempest-VolumeTypesAccessTest-547935671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-400ea139-60d0-4566-ac5c-c1a1420c3697" returned: 0 in 0.570s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e8857cec-7b74-41fd-82dd-a9ad2cbec77a tempest-VolumeTypesAccessTest-547935671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-400ea139-60d0-4566-ac5c-c1a1420c3697 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:57 devstack sudo[93444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-400ea139-60d0-4566-ac5c-c1a1420c3697 Jul 17 19:41:57 devstack sudo[93444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:57 devstack sudo[93444]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e8857cec-7b74-41fd-82dd-a9ad2cbec77a tempest-VolumeTypesAccessTest-547935671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-400ea139-60d0-4566-ac5c-c1a1420c3697" returned: 0 in 0.340s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:57 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e8857cec-7b74-41fd-82dd-a9ad2cbec77a tempest-VolumeTypesAccessTest-547935671 None] Lock "cinder-quobyte-400ea139-60d0-4566-ac5c-c1a1420c3697" released by "delete_volume" :: held 0.969s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:41:57 devstack cinder-volume[87726]: WARNING cinder.quota [None req-e8857cec-7b74-41fd-82dd-a9ad2cbec77a tempest-VolumeTypesAccessTest-547935671 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1831437322 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1831437322, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:41:57 devstack cinder-volume[87726]: WARNING cinder.quota [None req-e8857cec-7b74-41fd-82dd-a9ad2cbec77a tempest-VolumeTypesAccessTest-547935671 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1831437322 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1831437322, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:41:57 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:41:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] Flow 'volume_create_manager' (bf0dc371-f768-46f5-96fb-b18e9748cbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:41:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e225146c-db65-41ae-b7b5-f9c66852a7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:57 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-e8857cec-7b74-41fd-82dd-a9ad2cbec77a tempest-VolumeTypesAccessTest-547935671 None] Created reservations ['6ac1b85f-2161-4294-a083-1ed2380e2669', 'bfd2e982-9219-48a1-94b9-c0345086143e', 'ab766153-3ec2-4d14-8e93-0674abf33c19', 'd9718099-a0be-4a6c-8e75-cc5072026850'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:41:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e225146c-db65-41ae-b7b5-f9c66852a7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-797925466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ffb93c-0b04-4e9a-9748-fc188b725593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84266e1bc4604ae8b7ec6e1afe667f81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:41:58Z,use_quota=True,user_id='3f222cd08aed4993ab8e84259fef897b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29d94aa4-a35d-4aae-ab65-87e1c4461a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29d94aa4-a35d-4aae-ab65-87e1c4461a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f576d0-8434-4383-a893-f6e9e75a8593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f576d0-8434-4383-a893-f6e9e75a8593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21ffb93c-0b04-4e9a-9748-fc188b725593', 'volume_name': 'volume-21ffb93c-0b04-4e9a-9748-fc188b725593', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff04c765-a7e2-4cfb-9161-702ddf885894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff04c765-a7e2-4cfb-9161-702ddf885894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00a41106-3481-490b-86bf-2eb195b1d184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:58 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] Volume 21ffb93c-0b04-4e9a-9748-fc188b725593: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21ffb93c-0b04-4e9a-9748-fc188b725593', 'volume_size': 1} Jul 17 19:41:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-797925466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ffb93c-0b04-4e9a-9748-fc188b725593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84266e1bc4604ae8b7ec6e1afe667f81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:41:58Z,use_quota=True,user_id='3f222cd08aed4993ab8e84259fef897b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:41:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] Creating volume 21ffb93c-0b04-4e9a-9748-fc188b725593 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:41:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:41:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:41:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:41:58 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:41:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:58 devstack sudo[93447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593 1073741824 Jul 17 19:41:58 devstack sudo[93447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e8857cec-7b74-41fd-82dd-a9ad2cbec77a tempest-VolumeTypesAccessTest-547935671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:41:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e8857cec-7b74-41fd-82dd-a9ad2cbec77a tempest-VolumeTypesAccessTest-547935671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:41:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e8857cec-7b74-41fd-82dd-a9ad2cbec77a tempest-VolumeTypesAccessTest-547935671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:41:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e8857cec-7b74-41fd-82dd-a9ad2cbec77a tempest-VolumeTypesAccessTest-547935671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:41:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e8857cec-7b74-41fd-82dd-a9ad2cbec77a tempest-VolumeTypesAccessTest-547935671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e8857cec-7b74-41fd-82dd-a9ad2cbec77a tempest-VolumeTypesAccessTest-547935671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:58 devstack sudo[93449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:41:58 devstack sudo[93449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:58 devstack sudo[93449]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e8857cec-7b74-41fd-82dd-a9ad2cbec77a tempest-VolumeTypesAccessTest-547935671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.419s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:58 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-e8857cec-7b74-41fd-82dd-a9ad2cbec77a tempest-VolumeTypesAccessTest-547935671 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:41:58 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e8857cec-7b74-41fd-82dd-a9ad2cbec77a tempest-VolumeTypesAccessTest-547935671 None] Deleted volume successfully. Jul 17 19:41:58 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e8857cec-7b74-41fd-82dd-a9ad2cbec77a tempest-VolumeTypesAccessTest-547935671 None] Lock "cinder-400ea139-60d0-4566-ac5c-c1a1420c3697-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:41:58 devstack sudo[93447]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593 1073741824" returned: 0 in 0.722s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:41:58 devstack sudo[93457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593 Jul 17 19:41:58 devstack sudo[93457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:41:59 devstack sudo[93457]: pam_unix(sudo:session): session closed for user root Jul 17 19:41:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593" returned: 0 in 0.338s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:41:59 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:41:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:41:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00a41106-3481-490b-86bf-2eb195b1d184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21ffb93c-0b04-4e9a-9748-fc188b725593', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c112edd4-80b6-467d-bc02-a84ec8e247c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:41:59 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] Volume volume-21ffb93c-0b04-4e9a-9748-fc188b725593 (21ffb93c-0b04-4e9a-9748-fc188b725593): created successfully Jul 17 19:41:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c112edd4-80b6-467d-bc02-a84ec8e247c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:41:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] Flow 'volume_create_manager' (bf0dc371-f768-46f5-96fb-b18e9748cbfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:41:59 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-7b896adf-c370-44b5-9612-151d8a1e3bb9 tempest-VolumesDeleteCascade-2136189065 None] Created volume successfully. Jul 17 19:42:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-304c4941-93d7-4c22-a54b-50d3b08dbf97 tempest-VolumesDeleteCascade-2136189065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:42:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-304c4941-93d7-4c22-a54b-50d3b08dbf97 tempest-VolumesDeleteCascade-2136189065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:42:00 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-304c4941-93d7-4c22-a54b-50d3b08dbf97 tempest-VolumesDeleteCascade-2136189065 None] Creating offline snapshot 92e5e821-31ad-4b91-a879-99f8661c1591 of volume 21ffb93c-0b04-4e9a-9748-fc188b725593 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:42:00 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4566deb-720f-4d59-9c0d-ae9a4ff4a454]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:42:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-304c4941-93d7-4c22-a54b-50d3b08dbf97 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:00 devstack sudo[93461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593 Jul 17 19:42:00 devstack sudo[93461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:00 devstack sudo[93461]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-304c4941-93d7-4c22-a54b-50d3b08dbf97 tempest-VolumesDeleteCascade-2136189065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593" returned: 0 in 0.451s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-304c4941-93d7-4c22-a54b-50d3b08dbf97 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:00 devstack sudo[93466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591 1G Jul 17 19:42:00 devstack sudo[93466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:01 devstack sudo[93466]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-304c4941-93d7-4c22-a54b-50d3b08dbf97 tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591 1G" returned: 0 in 0.538s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-304c4941-93d7-4c22-a54b-50d3b08dbf97 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21ffb93c-0b04-4e9a-9748-fc188b725593 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:01 devstack sudo[93472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21ffb93c-0b04-4e9a-9748-fc188b725593 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591 Jul 17 19:42:01 devstack sudo[93472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:01 devstack sudo[93472]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-304c4941-93d7-4c22-a54b-50d3b08dbf97 tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21ffb93c-0b04-4e9a-9748-fc188b725593 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591" returned: 0 in 0.366s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:01 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-304c4941-93d7-4c22-a54b-50d3b08dbf97 tempest-VolumesDeleteCascade-2136189065 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591 is being set with open permissions: ugo+rw Jul 17 19:42:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-304c4941-93d7-4c22-a54b-50d3b08dbf97 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:01 devstack sudo[93477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591 Jul 17 19:42:01 devstack sudo[93477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:02 devstack sudo[93477]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-304c4941-93d7-4c22-a54b-50d3b08dbf97 tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591" returned: 0 in 0.303s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-304c4941-93d7-4c22-a54b-50d3b08dbf97 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:02 devstack sudo[93480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.info Jul 17 19:42:02 devstack sudo[93480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:02 devstack sudo[93480]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-304c4941-93d7-4c22-a54b-50d3b08dbf97 tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.info" returned: 0 in 0.354s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:02 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-304c4941-93d7-4c22-a54b-50d3b08dbf97 tempest-VolumesDeleteCascade-2136189065 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.info is being set with open permissions: ugo+rw Jul 17 19:42:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-304c4941-93d7-4c22-a54b-50d3b08dbf97 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:02 devstack sudo[93483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.info Jul 17 19:42:02 devstack sudo[93483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:02 devstack sudo[93483]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-304c4941-93d7-4c22-a54b-50d3b08dbf97 tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.info" returned: 0 in 0.337s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-304c4941-93d7-4c22-a54b-50d3b08dbf97 tempest-VolumesDeleteCascade-2136189065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.494s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:42:02 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-304c4941-93d7-4c22-a54b-50d3b08dbf97 tempest-VolumesDeleteCascade-2136189065 None] Create snapshot completed successfully Jul 17 19:42:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-72d20c4d-a214-4823-8ab2-d4450056da46 tempest-VolumesDeleteCascade-2136189065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:42:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-72d20c4d-a214-4823-8ab2-d4450056da46 tempest-VolumesDeleteCascade-2136189065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:42:03 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-72d20c4d-a214-4823-8ab2-d4450056da46 tempest-VolumesDeleteCascade-2136189065 None] Creating offline snapshot b73f0235-964d-4fef-8591-ddb445db1187 of volume 21ffb93c-0b04-4e9a-9748-fc188b725593 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:42:03 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd40284f-addf-4e80-a52e-812b9fd10fa0]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:42:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-72d20c4d-a214-4823-8ab2-d4450056da46 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:04 devstack sudo[93490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591 Jul 17 19:42:04 devstack sudo[93490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:04 devstack sudo[93490]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-72d20c4d-a214-4823-8ab2-d4450056da46 tempest-VolumesDeleteCascade-2136189065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591" returned: 0 in 0.572s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:04 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-72d20c4d-a214-4823-8ab2-d4450056da46 tempest-VolumesDeleteCascade-2136189065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21ffb93c-0b04-4e9a-9748-fc188b725593(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:42:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-72d20c4d-a214-4823-8ab2-d4450056da46 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.b73f0235-964d-4fef-8591-ddb445db1187 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:04 devstack sudo[93496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.b73f0235-964d-4fef-8591-ddb445db1187 1G Jul 17 19:42:04 devstack sudo[93496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:05 devstack sudo[93496]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-72d20c4d-a214-4823-8ab2-d4450056da46 tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.b73f0235-964d-4fef-8591-ddb445db1187 1G" returned: 0 in 0.661s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-72d20c4d-a214-4823-8ab2-d4450056da46 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.b73f0235-964d-4fef-8591-ddb445db1187 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:05 devstack sudo[93503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.b73f0235-964d-4fef-8591-ddb445db1187 Jul 17 19:42:05 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:05 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-72d20c4d-a214-4823-8ab2-d4450056da46 tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.b73f0235-964d-4fef-8591-ddb445db1187" returned: 0 in 0.494s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:05 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-72d20c4d-a214-4823-8ab2-d4450056da46 tempest-VolumesDeleteCascade-2136189065 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.b73f0235-964d-4fef-8591-ddb445db1187 is being set with open permissions: ugo+rw Jul 17 19:42:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-72d20c4d-a214-4823-8ab2-d4450056da46 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.b73f0235-964d-4fef-8591-ddb445db1187 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:05 devstack sudo[93518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.b73f0235-964d-4fef-8591-ddb445db1187 Jul 17 19:42:05 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:05 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-72d20c4d-a214-4823-8ab2-d4450056da46 tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.b73f0235-964d-4fef-8591-ddb445db1187" returned: 0 in 0.303s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-72d20c4d-a214-4823-8ab2-d4450056da46 tempest-VolumesDeleteCascade-2136189065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.196s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:42:06 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-72d20c4d-a214-4823-8ab2-d4450056da46 tempest-VolumesDeleteCascade-2136189065 None] Create snapshot completed successfully Jul 17 19:42:07 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Acquiring lock "cinder-21ffb93c-0b04-4e9a-9748-fc188b725593-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:42:07 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-21ffb93c-0b04-4e9a-9748-fc188b725593-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:42:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Performing cascade delete. {{(pid=87726) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 17 19:42:07 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Acquiring lock "cinder-92e5e821-31ad-4b91-a879-99f8661c1591-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:42:07 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-92e5e821-31ad-4b91-a879-99f8661c1591-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:42:07 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Acquiring lock "cinder-quobyte-21ffb93c-0b04-4e9a-9748-fc188b725593" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:42:07 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-quobyte-21ffb93c-0b04-4e9a-9748-fc188b725593" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:42:07 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Acquiring lock "cinder-quobyte-92e5e821-31ad-4b91-a879-99f8661c1591" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:42:07 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-quobyte-92e5e821-31ad-4b91-a879-99f8661c1591" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:42:07 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Deleting offline snapshot 92e5e821-31ad-4b91-a879-99f8661c1591 of volume 21ffb93c-0b04-4e9a-9748-fc188b725593 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:42:07 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] snapshot_file for this snap is: volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:42:07 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd944ae-ca21-4a71-8e80-94c95bcd1c4b]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:42:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:07 devstack sudo[93526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591 Jul 17 19:42:07 devstack sudo[93526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:07 devstack sudo[93526]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591" returned: 0 in 0.593s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:07 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21ffb93c-0b04-4e9a-9748-fc188b725593(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:42:07 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e179a1-9fb6-4684-8c1d-5feec8a77f90]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:42:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:08 devstack sudo[93532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593 Jul 17 19:42:08 devstack sudo[93532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:08 devstack sudo[93532]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593" returned: 0 in 0.508s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:08 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f8a8f0-1db3-45cb-ad42-68c687b9034e]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:42:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.b73f0235-964d-4fef-8591-ddb445db1187 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:08 devstack sudo[93538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.b73f0235-964d-4fef-8591-ddb445db1187 Jul 17 19:42:08 devstack sudo[93538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.b73f0235-964d-4fef-8591-ddb445db1187" returned: 0 in 0.598s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:09 devstack sudo[93538]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21ffb93c-0b04-4e9a-9748-fc188b725593(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:42:09 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd92d4af-5680-4fe4-ba21-f403e2a1fecc]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:42:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:09 devstack sudo[93551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591 Jul 17 19:42:09 devstack sudo[93551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:09 devstack sudo[93551]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591" returned: 0 in 0.770s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21ffb93c-0b04-4e9a-9748-fc188b725593(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:42:10 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[2148b51a-9367-440c-a767-3e7621575fcb]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:42:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:10 devstack sudo[93610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593 Jul 17 19:42:10 devstack sudo[93610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:10 devstack sudo[93610]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593" returned: 0 in 0.998s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:11 devstack sudo[93635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591 Jul 17 19:42:11 devstack sudo[93635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:11 devstack sudo[93635]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591" returned: 0 in 0.743s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:11 devstack sudo[93644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591 Jul 17 19:42:11 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:12 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.92e5e821-31ad-4b91-a879-99f8661c1591" returned: 0 in 0.547s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21ffb93c-0b04-4e9a-9748-fc188b725593 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.b73f0235-964d-4fef-8591-ddb445db1187 -F qcow2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:12 devstack sudo[93647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21ffb93c-0b04-4e9a-9748-fc188b725593 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.b73f0235-964d-4fef-8591-ddb445db1187 -F qcow2 Jul 17 19:42:12 devstack sudo[93647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:12 devstack sudo[93647]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21ffb93c-0b04-4e9a-9748-fc188b725593 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.b73f0235-964d-4fef-8591-ddb445db1187 -F qcow2" returned: 0 in 0.657s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-quobyte-92e5e821-31ad-4b91-a879-99f8661c1591" released by "_delete_snapshot" :: held 5.744s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:42:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-quobyte-21ffb93c-0b04-4e9a-9748-fc188b725593" released by "delete_snapshot" :: held 5.795s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:42:13 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Created reservations ['591ccb2d-9ee3-40e4-ad53-cef8fd2561e3', 'a05be055-b9e0-46e5-941c-b475d043da13', 'bba25e2d-9c62-49f7-ba33-98db144f0b20', '6d1b9b88-cfac-4edc-81f4-d8a0db1f93c8'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:42:13 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Delete snapshot completed successfully. Jul 17 19:42:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-92e5e821-31ad-4b91-a879-99f8661c1591-delete_snapshot" released by "delete_snapshot" :: held 6.195s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:42:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Acquiring lock "cinder-b73f0235-964d-4fef-8591-ddb445db1187-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:42:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-b73f0235-964d-4fef-8591-ddb445db1187-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:42:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Acquiring lock "cinder-quobyte-21ffb93c-0b04-4e9a-9748-fc188b725593" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:42:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-quobyte-21ffb93c-0b04-4e9a-9748-fc188b725593" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:42:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Acquiring lock "cinder-quobyte-b73f0235-964d-4fef-8591-ddb445db1187" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:42:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-quobyte-b73f0235-964d-4fef-8591-ddb445db1187" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:42:13 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Deleting offline snapshot b73f0235-964d-4fef-8591-ddb445db1187 of volume 21ffb93c-0b04-4e9a-9748-fc188b725593 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:42:13 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] snapshot_file for this snap is: volume-21ffb93c-0b04-4e9a-9748-fc188b725593.b73f0235-964d-4fef-8591-ddb445db1187 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:42:13 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[b281a866-6510-436a-a909-e7c35e2dcae1]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:42:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.b73f0235-964d-4fef-8591-ddb445db1187 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:13 devstack sudo[93666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.b73f0235-964d-4fef-8591-ddb445db1187 Jul 17 19:42:13 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:14 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.b73f0235-964d-4fef-8591-ddb445db1187" returned: 0 in 0.671s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:14 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21ffb93c-0b04-4e9a-9748-fc188b725593(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:42:14 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c44a3d5-adef-4b3d-8249-8cbfda66a849]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:42:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:14 devstack sudo[93673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593 Jul 17 19:42:14 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:14 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593" returned: 0 in 0.503s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.b73f0235-964d-4fef-8591-ddb445db1187 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:14 devstack sudo[93679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.b73f0235-964d-4fef-8591-ddb445db1187 Jul 17 19:42:14 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:42:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:42:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:42:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:42:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:42:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:42:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:15 devstack sudo[93686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:42:15 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:15 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.b73f0235-964d-4fef-8591-ddb445db1187" returned: 0 in 0.597s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.b73f0235-964d-4fef-8591-ddb445db1187 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:15 devstack sudo[93688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.b73f0235-964d-4fef-8591-ddb445db1187 Jul 17 19:42:15 devstack sudo[93688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:15 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.390s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:15 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:42:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager._thread_info {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:42:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread count: 8 {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 19:42:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread info: [<_MainThread(MainThread, started 130066227544192)>, , , , , , , ] {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 19:42:15 devstack sudo[93688]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593.b73f0235-964d-4fef-8591-ddb445db1187" returned: 0 in 0.434s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-quobyte-b73f0235-964d-4fef-8591-ddb445db1187" released by "_delete_snapshot" :: held 2.440s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:42:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-quobyte-21ffb93c-0b04-4e9a-9748-fc188b725593" released by "delete_snapshot" :: held 2.495s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:42:16 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Created reservations ['1ec4a92f-c919-48ea-8173-dfd92722c895', 'e5c14b9f-b626-4b25-b00f-8f08d7cbcf52', '508659a2-c1b7-4809-9206-f62950bae174', '429e0fdc-2fac-461c-bacb-5c4e00a625de'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:42:16 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Delete snapshot completed successfully. Jul 17 19:42:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-b73f0235-964d-4fef-8591-ddb445db1187-delete_snapshot" released by "delete_snapshot" :: held 2.802s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:42:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Snapshots deleted, issuing volume delete {{(pid=87726) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 17 19:42:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Acquiring lock "cinder-quobyte-21ffb93c-0b04-4e9a-9748-fc188b725593" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:42:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-quobyte-21ffb93c-0b04-4e9a-9748-fc188b725593" acquired by "delete_volume" :: waited 0.026s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:42:16 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[004c3d50-4b9d-4a7f-afd2-258bdeeca597]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:42:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:16 devstack sudo[93694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593 Jul 17 19:42:16 devstack sudo[93694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:16 devstack sudo[93694]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593" returned: 0 in 0.575s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:16 devstack sudo[93699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593 Jul 17 19:42:16 devstack sudo[93699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:17 devstack sudo[93699]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-21ffb93c-0b04-4e9a-9748-fc188b725593" returned: 0 in 0.576s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:17 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-quobyte-21ffb93c-0b04-4e9a-9748-fc188b725593" released by "delete_volume" :: held 1.314s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:42:17 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Created reservations ['025dae09-d365-4c03-b2c1-8747bc4ae732', 'bbecee73-2262-4fde-9450-cfb5833f8d13', '97314ed2-27ce-414d-b335-76740a79b069', 'e7200f6d-5230-4bdb-9782-8da17a9b7120'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:42:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:42:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:42:18 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:42:18 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:42:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:42:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:18 devstack sudo[93757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:42:18 devstack sudo[93757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:18 devstack sudo[93757]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.569s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:18 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:42:18 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Deleted volume successfully. Jul 17 19:42:18 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99e2cef8-58a2-4ba7-ae68-9acdb61432ad tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-21ffb93c-0b04-4e9a-9748-fc188b725593-delete_volume" released by "delete_volume" :: held 11.770s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:42:19 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:42:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] Flow 'volume_create_manager' (a17398d7-d2c3-4e8b-8880-22e100129549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:42:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1698d8d-f609-4a0e-a407-e33ca186516c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1698d8d-f609-4a0e-a407-e33ca186516c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-695055803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ace9569a-ab14-470b-8751-6f4507b867e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84266e1bc4604ae8b7ec6e1afe667f81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:42:20Z,use_quota=True,user_id='3f222cd08aed4993ab8e84259fef897b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca831b2-3216-44aa-9597-576eb4846cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca831b2-3216-44aa-9597-576eb4846cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc10553b-8d97-4dfa-91d8-7422b238539e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc10553b-8d97-4dfa-91d8-7422b238539e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ace9569a-ab14-470b-8751-6f4507b867e3', 'volume_name': 'volume-ace9569a-ab14-470b-8751-6f4507b867e3', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb9e47f-6962-4272-8132-47b7e97d3996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb9e47f-6962-4272-8132-47b7e97d3996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f82a1c7f-71ef-4225-9a35-f9cfea3b35bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:19 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] Volume ace9569a-ab14-470b-8751-6f4507b867e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ace9569a-ab14-470b-8751-6f4507b867e3', 'volume_size': 1} Jul 17 19:42:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:42:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:42:19 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-695055803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ace9569a-ab14-470b-8751-6f4507b867e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84266e1bc4604ae8b7ec6e1afe667f81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:42:20Z,use_quota=True,user_id='3f222cd08aed4993ab8e84259fef897b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:42:19 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] Creating volume ace9569a-ab14-470b-8751-6f4507b867e3 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:42:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:42:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:42:19 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:42:19 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:42:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:42:19 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:42:19 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:42:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:19 devstack sudo[93776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3 1073741824 Jul 17 19:42:19 devstack sudo[93776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:20 devstack sudo[93776]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3 1073741824" returned: 0 in 0.795s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:20 devstack sudo[93781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3 Jul 17 19:42:20 devstack sudo[93781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:21 devstack sudo[93781]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3" returned: 0 in 0.464s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:42:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:42:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f82a1c7f-71ef-4225-9a35-f9cfea3b35bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ace9569a-ab14-470b-8751-6f4507b867e3', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4336e88-2d7f-4ec1-be64-d0c4c1f61451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:21 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] Volume volume-ace9569a-ab14-470b-8751-6f4507b867e3 (ace9569a-ab14-470b-8751-6f4507b867e3): created successfully Jul 17 19:42:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4336e88-2d7f-4ec1-be64-d0c4c1f61451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] Flow 'volume_create_manager' (a17398d7-d2c3-4e8b-8880-22e100129549) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:42:21 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-2cf8fdf5-08ca-40bc-9eab-f40508b0042a tempest-VolumesDeleteCascade-2136189065 None] Created volume successfully. Jul 17 19:42:21 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:42:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] Flow 'volume_create_manager' (2301f5b5-181b-46d1-b4a8-ef246c7940cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:42:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42c0036-0bba-4b04-bd80-e8e41f1436e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42c0036-0bba-4b04-bd80-e8e41f1436e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1225911929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57789875-3b7d-4853-9fa6-6f1ab65993e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c178dd4d2c0041f786e5599fe1c1c06f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:42:21Z,use_quota=True,user_id='c8e6aa6bfcae419f96be63926c9ff1c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64ac2d3-1d09-4605-a7d9-bcd0a07cbf23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64ac2d3-1d09-4605-a7d9-bcd0a07cbf23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c938724-16f6-4240-9461-00f5406b9227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c938724-16f6-4240-9461-00f5406b9227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57789875-3b7d-4853-9fa6-6f1ab65993e9', 'volume_name': 'volume-57789875-3b7d-4853-9fa6-6f1ab65993e9', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3496eaad-595e-463e-9171-bdbfa316822f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3496eaad-595e-463e-9171-bdbfa316822f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd116002-4da4-48c4-bfd3-c98df6116578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:21 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] Volume 57789875-3b7d-4853-9fa6-6f1ab65993e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57789875-3b7d-4853-9fa6-6f1ab65993e9', 'volume_size': 1} Jul 17 19:42:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:42:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:42:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1225911929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57789875-3b7d-4853-9fa6-6f1ab65993e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c178dd4d2c0041f786e5599fe1c1c06f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:42:21Z,use_quota=True,user_id='c8e6aa6bfcae419f96be63926c9ff1c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:42:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] Creating volume 57789875-3b7d-4853-9fa6-6f1ab65993e9 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:42:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:42:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:42:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:42:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:42:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:42:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:42:21 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:42:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:21 devstack sudo[93784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9 1073741824 Jul 17 19:42:21 devstack sudo[93784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cc2af5d3-b036-48e8-9ff1-db3fc4d8f6f9 tempest-VolumesDeleteCascade-2136189065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:42:22 devstack sudo[93784]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9 1073741824" returned: 0 in 0.671s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:22 devstack sudo[93791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9 Jul 17 19:42:22 devstack sudo[93791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:22 devstack sudo[93791]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9" returned: 0 in 0.397s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:42:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:42:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cc2af5d3-b036-48e8-9ff1-db3fc4d8f6f9 tempest-VolumesDeleteCascade-2136189065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.737s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:42:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd116002-4da4-48c4-bfd3-c98df6116578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57789875-3b7d-4853-9fa6-6f1ab65993e9', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b06585a-6d57-414d-87a2-8320c36c3c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-cc2af5d3-b036-48e8-9ff1-db3fc4d8f6f9 tempest-VolumesDeleteCascade-2136189065 None] Creating offline snapshot dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f of volume ace9569a-ab14-470b-8751-6f4507b867e3 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:42:22 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] Volume volume-57789875-3b7d-4853-9fa6-6f1ab65993e9 (57789875-3b7d-4853-9fa6-6f1ab65993e9): created successfully Jul 17 19:42:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b06585a-6d57-414d-87a2-8320c36c3c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] Flow 'volume_create_manager' (2301f5b5-181b-46d1-b4a8-ef246c7940cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:42:22 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b01cb20-7713-4502-bf6e-559b8359d8aa]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:42:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cc2af5d3-b036-48e8-9ff1-db3fc4d8f6f9 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:23 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-0bc0a40a-7567-45cd-b943-82bf7d657b53 tempest-SnapshotMetadataTestJSON-123221891 None] Created volume successfully. Jul 17 19:42:23 devstack sudo[93795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3 Jul 17 19:42:23 devstack sudo[93795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:23 devstack sudo[93795]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cc2af5d3-b036-48e8-9ff1-db3fc4d8f6f9 tempest-VolumesDeleteCascade-2136189065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3" returned: 0 in 0.487s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cc2af5d3-b036-48e8-9ff1-db3fc4d8f6f9 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3.dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:23 devstack sudo[93801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3.dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f 1G Jul 17 19:42:23 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-20510f19-04a9-4095-a37a-97d4bd62afc3 tempest-SnapshotMetadataTestJSON-123221891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:42:24 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cc2af5d3-b036-48e8-9ff1-db3fc4d8f6f9 tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3.dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f 1G" returned: 0 in 0.790s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cc2af5d3-b036-48e8-9ff1-db3fc4d8f6f9 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ace9569a-ab14-470b-8751-6f4507b867e3 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3.dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:24 devstack sudo[93823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ace9569a-ab14-470b-8751-6f4507b867e3 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3.dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f Jul 17 19:42:24 devstack sudo[93823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:24 devstack sudo[93823]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cc2af5d3-b036-48e8-9ff1-db3fc4d8f6f9 tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ace9569a-ab14-470b-8751-6f4507b867e3 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3.dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f" returned: 0 in 0.311s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:24 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-cc2af5d3-b036-48e8-9ff1-db3fc4d8f6f9 tempest-VolumesDeleteCascade-2136189065 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3.dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f is being set with open permissions: ugo+rw Jul 17 19:42:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cc2af5d3-b036-48e8-9ff1-db3fc4d8f6f9 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3.dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:24 devstack sudo[93828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3.dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f Jul 17 19:42:24 devstack sudo[93828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:24 devstack sudo[93828]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cc2af5d3-b036-48e8-9ff1-db3fc4d8f6f9 tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3.dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f" returned: 0 in 0.243s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cc2af5d3-b036-48e8-9ff1-db3fc4d8f6f9 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:24 devstack sudo[93831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3.info Jul 17 19:42:24 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:25 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cc2af5d3-b036-48e8-9ff1-db3fc4d8f6f9 tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3.info" returned: 0 in 0.244s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:25 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-cc2af5d3-b036-48e8-9ff1-db3fc4d8f6f9 tempest-VolumesDeleteCascade-2136189065 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3.info is being set with open permissions: ugo+rw Jul 17 19:42:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cc2af5d3-b036-48e8-9ff1-db3fc4d8f6f9 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:25 devstack sudo[93834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3.info Jul 17 19:42:25 devstack sudo[93834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:25 devstack sudo[93834]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cc2af5d3-b036-48e8-9ff1-db3fc4d8f6f9 tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3.info" returned: 0 in 0.247s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cc2af5d3-b036-48e8-9ff1-db3fc4d8f6f9 tempest-VolumesDeleteCascade-2136189065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.517s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:42:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-20510f19-04a9-4095-a37a-97d4bd62afc3 tempest-SnapshotMetadataTestJSON-123221891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.255s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:42:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-20510f19-04a9-4095-a37a-97d4bd62afc3 tempest-SnapshotMetadataTestJSON-123221891 None] Creating offline snapshot 88b2a306-7b7a-4c5c-83aa-1c8cd2c325dc of volume 57789875-3b7d-4853-9fa6-6f1ab65993e9 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:42:25 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-cc2af5d3-b036-48e8-9ff1-db3fc4d8f6f9 tempest-VolumesDeleteCascade-2136189065 None] Create snapshot completed successfully Jul 17 19:42:25 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1082612-7f03-4697-8a00-3d910023d7b7]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:42:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-20510f19-04a9-4095-a37a-97d4bd62afc3 tempest-SnapshotMetadataTestJSON-123221891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:25 devstack sudo[93837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9 Jul 17 19:42:25 devstack sudo[93837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:25 devstack sudo[93837]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-20510f19-04a9-4095-a37a-97d4bd62afc3 tempest-SnapshotMetadataTestJSON-123221891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9" returned: 0 in 0.359s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-20510f19-04a9-4095-a37a-97d4bd62afc3 tempest-SnapshotMetadataTestJSON-123221891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9.88b2a306-7b7a-4c5c-83aa-1c8cd2c325dc 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:25 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9.88b2a306-7b7a-4c5c-83aa-1c8cd2c325dc 1G Jul 17 19:42:25 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:26 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-20510f19-04a9-4095-a37a-97d4bd62afc3 tempest-SnapshotMetadataTestJSON-123221891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9.88b2a306-7b7a-4c5c-83aa-1c8cd2c325dc 1G" returned: 0 in 0.402s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-20510f19-04a9-4095-a37a-97d4bd62afc3 tempest-SnapshotMetadataTestJSON-123221891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57789875-3b7d-4853-9fa6-6f1ab65993e9 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9.88b2a306-7b7a-4c5c-83aa-1c8cd2c325dc {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:26 devstack sudo[93847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57789875-3b7d-4853-9fa6-6f1ab65993e9 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9.88b2a306-7b7a-4c5c-83aa-1c8cd2c325dc Jul 17 19:42:26 devstack sudo[93847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:26 devstack sudo[93847]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-20510f19-04a9-4095-a37a-97d4bd62afc3 tempest-SnapshotMetadataTestJSON-123221891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57789875-3b7d-4853-9fa6-6f1ab65993e9 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9.88b2a306-7b7a-4c5c-83aa-1c8cd2c325dc" returned: 0 in 0.300s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:26 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-20510f19-04a9-4095-a37a-97d4bd62afc3 tempest-SnapshotMetadataTestJSON-123221891 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9.88b2a306-7b7a-4c5c-83aa-1c8cd2c325dc is being set with open permissions: ugo+rw Jul 17 19:42:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-20510f19-04a9-4095-a37a-97d4bd62afc3 tempest-SnapshotMetadataTestJSON-123221891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9.88b2a306-7b7a-4c5c-83aa-1c8cd2c325dc {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:26 devstack sudo[93852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9.88b2a306-7b7a-4c5c-83aa-1c8cd2c325dc Jul 17 19:42:26 devstack sudo[93852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:26 devstack sudo[93852]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-20510f19-04a9-4095-a37a-97d4bd62afc3 tempest-SnapshotMetadataTestJSON-123221891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9.88b2a306-7b7a-4c5c-83aa-1c8cd2c325dc" returned: 0 in 0.300s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-20510f19-04a9-4095-a37a-97d4bd62afc3 tempest-SnapshotMetadataTestJSON-123221891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:26 devstack sudo[93855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9.info Jul 17 19:42:26 devstack sudo[93855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:26 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:42:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Flow 'volume_create_manager' (69a317c6-fd1e-4800-99c4-2855462126d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:42:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec7d9db6-f4b8-4ec8-ab1d-e3531dc60cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec7d9db6-f4b8-4ec8-ab1d-e3531dc60cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-45810703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b0a11f1-9ce0-4751-a34d-5df23779efe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84266e1bc4604ae8b7ec6e1afe667f81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:42:27Z,use_quota=True,user_id='3f222cd08aed4993ab8e84259fef897b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1353447-10e6-4792-b175-aff80fe942e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1353447-10e6-4792-b175-aff80fe942e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6715226-2b5d-49ec-9896-8b6aa06fc956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6715226-2b5d-49ec-9896-8b6aa06fc956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5b0a11f1-9ce0-4751-a34d-5df23779efe1', 'volume_name': 'volume-5b0a11f1-9ce0-4751-a34d-5df23779efe1', 'volume_size': 1, 'snapshot_id': 'dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f'}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (825fc690-18d1-4ecc-8c43-a7570c3d618a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (825fc690-18d1-4ecc-8c43-a7570c3d618a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f18b3c-450d-454e-b75e-9a3869abc816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:27 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Volume 5b0a11f1-9ce0-4751-a34d-5df23779efe1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5b0a11f1-9ce0-4751-a34d-5df23779efe1', 'volume_size': 1, 'snapshot_id': 'dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f'} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:42:27 devstack sudo[93855]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-20510f19-04a9-4095-a37a-97d4bd62afc3 tempest-SnapshotMetadataTestJSON-123221891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9.info" returned: 0 in 0.261s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:27 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-20510f19-04a9-4095-a37a-97d4bd62afc3 tempest-SnapshotMetadataTestJSON-123221891 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9.info is being set with open permissions: ugo+rw Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-20510f19-04a9-4095-a37a-97d4bd62afc3 tempest-SnapshotMetadataTestJSON-123221891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:27 devstack sudo[93858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9.info Jul 17 19:42:27 devstack sudo[93858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:27 devstack sudo[93858]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-20510f19-04a9-4095-a37a-97d4bd62afc3 tempest-SnapshotMetadataTestJSON-123221891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9.info" returned: 0 in 0.273s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-20510f19-04a9-4095-a37a-97d4bd62afc3 tempest-SnapshotMetadataTestJSON-123221891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.994s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.324s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Acquiring lock "cinder-quobyte-dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f-5b0a11f1-9ce0-4751-a34d-5df23779efe1" by "_create_volume_from_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-quobyte-dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f-5b0a11f1-9ce0-4751-a34d-5df23779efe1" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Creating volume 5b0a11f1-9ce0-4751-a34d-5df23779efe1 from snapshot dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f {{(pid=87726) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Acquiring lock "cinder-quobyte-5b0a11f1-9ce0-4751-a34d-5df23779efe1" by "_copy_volume_from_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:42:27 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-20510f19-04a9-4095-a37a-97d4bd62afc3 tempest-SnapshotMetadataTestJSON-123221891 None] Create snapshot completed successfully Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-quobyte-5b0a11f1-9ce0-4751-a34d-5df23779efe1" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] snapshot: dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f, volume: 5b0a11f1-9ce0-4751-a34d-5df23779efe1, {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa0583e-e6c9-44e1-b51f-06fa93450331]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3.dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:27 devstack sudo[93861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3.dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f Jul 17 19:42:27 devstack sudo[93861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:27 devstack sudo[93861]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3.dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f" returned: 0 in 0.374s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ace9569a-ab14-470b-8751-6f4507b867e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3 {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Creating direct copy from snapshot {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[02009cd8-eef5-4934-be5d-d3eb98629f27]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:42:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:27 devstack sudo[93866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3 Jul 17 19:42:27 devstack sudo[93866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:28 devstack sudo[93866]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3" returned: 0 in 0.386s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:28 devstack cinder-volume[87726]: DEBUG cinder.utils [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Path /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5b0a11f1-9ce0-4751-a34d-5df23779efe1 not found in is_blk_device check {{(pid=87726) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 19:42:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5b0a11f1-9ce0-4751-a34d-5df23779efe1 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:28 devstack sudo[93871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5b0a11f1-9ce0-4751-a34d-5df23779efe1 Jul 17 19:42:28 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2a213d15-992a-490c-8f9e-06aa7ea947f1 tempest-SnapshotMetadataTestJSON-123221891 None] Acquiring lock "cinder-88b2a306-7b7a-4c5c-83aa-1c8cd2c325dc-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:42:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2a213d15-992a-490c-8f9e-06aa7ea947f1 tempest-SnapshotMetadataTestJSON-123221891 None] Lock "cinder-88b2a306-7b7a-4c5c-83aa-1c8cd2c325dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:42:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2a213d15-992a-490c-8f9e-06aa7ea947f1 tempest-SnapshotMetadataTestJSON-123221891 None] Acquiring lock "cinder-quobyte-57789875-3b7d-4853-9fa6-6f1ab65993e9" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:42:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2a213d15-992a-490c-8f9e-06aa7ea947f1 tempest-SnapshotMetadataTestJSON-123221891 None] Lock "cinder-quobyte-57789875-3b7d-4853-9fa6-6f1ab65993e9" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:42:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2a213d15-992a-490c-8f9e-06aa7ea947f1 tempest-SnapshotMetadataTestJSON-123221891 None] Acquiring lock "cinder-quobyte-88b2a306-7b7a-4c5c-83aa-1c8cd2c325dc" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:42:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2a213d15-992a-490c-8f9e-06aa7ea947f1 tempest-SnapshotMetadataTestJSON-123221891 None] Lock "cinder-quobyte-88b2a306-7b7a-4c5c-83aa-1c8cd2c325dc" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:42:29 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-2a213d15-992a-490c-8f9e-06aa7ea947f1 tempest-SnapshotMetadataTestJSON-123221891 None] Deleting offline snapshot 88b2a306-7b7a-4c5c-83aa-1c8cd2c325dc of volume 57789875-3b7d-4853-9fa6-6f1ab65993e9 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:42:29 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-2a213d15-992a-490c-8f9e-06aa7ea947f1 tempest-SnapshotMetadataTestJSON-123221891 None] snapshot_file for this snap is: volume-57789875-3b7d-4853-9fa6-6f1ab65993e9.88b2a306-7b7a-4c5c-83aa-1c8cd2c325dc {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:42:29 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[383ea069-519d-40ab-9020-746a096b5d24]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:42:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2a213d15-992a-490c-8f9e-06aa7ea947f1 tempest-SnapshotMetadataTestJSON-123221891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9.88b2a306-7b7a-4c5c-83aa-1c8cd2c325dc {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:30 devstack sudo[93885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9.88b2a306-7b7a-4c5c-83aa-1c8cd2c325dc Jul 17 19:42:30 devstack sudo[93885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:30 devstack sudo[93885]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2a213d15-992a-490c-8f9e-06aa7ea947f1 tempest-SnapshotMetadataTestJSON-123221891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9.88b2a306-7b7a-4c5c-83aa-1c8cd2c325dc" returned: 0 in 0.974s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:30 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-2a213d15-992a-490c-8f9e-06aa7ea947f1 tempest-SnapshotMetadataTestJSON-123221891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57789875-3b7d-4853-9fa6-6f1ab65993e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:42:30 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[90990bc2-0304-4102-a108-59ffabb86896]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:42:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2a213d15-992a-490c-8f9e-06aa7ea947f1 tempest-SnapshotMetadataTestJSON-123221891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:31 devstack sudo[93890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9 Jul 17 19:42:31 devstack sudo[93890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:31 devstack sudo[93890]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2a213d15-992a-490c-8f9e-06aa7ea947f1 tempest-SnapshotMetadataTestJSON-123221891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9" returned: 0 in 0.970s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2a213d15-992a-490c-8f9e-06aa7ea947f1 tempest-SnapshotMetadataTestJSON-123221891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9.88b2a306-7b7a-4c5c-83aa-1c8cd2c325dc {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:31 devstack sudo[93897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9.88b2a306-7b7a-4c5c-83aa-1c8cd2c325dc Jul 17 19:42:31 devstack sudo[93897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:32 devstack sudo[93897]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2a213d15-992a-490c-8f9e-06aa7ea947f1 tempest-SnapshotMetadataTestJSON-123221891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9.88b2a306-7b7a-4c5c-83aa-1c8cd2c325dc" returned: 0 in 1.018s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2a213d15-992a-490c-8f9e-06aa7ea947f1 tempest-SnapshotMetadataTestJSON-123221891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9.88b2a306-7b7a-4c5c-83aa-1c8cd2c325dc {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:32 devstack sudo[93904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9.88b2a306-7b7a-4c5c-83aa-1c8cd2c325dc Jul 17 19:42:32 devstack sudo[93904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:33 devstack sudo[93904]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2a213d15-992a-490c-8f9e-06aa7ea947f1 tempest-SnapshotMetadataTestJSON-123221891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9.88b2a306-7b7a-4c5c-83aa-1c8cd2c325dc" returned: 0 in 0.934s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:33 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2a213d15-992a-490c-8f9e-06aa7ea947f1 tempest-SnapshotMetadataTestJSON-123221891 None] Lock "cinder-quobyte-88b2a306-7b7a-4c5c-83aa-1c8cd2c325dc" released by "_delete_snapshot" :: held 4.190s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:42:33 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2a213d15-992a-490c-8f9e-06aa7ea947f1 tempest-SnapshotMetadataTestJSON-123221891 None] Lock "cinder-quobyte-57789875-3b7d-4853-9fa6-6f1ab65993e9" released by "delete_snapshot" :: held 4.254s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:42:34 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-2a213d15-992a-490c-8f9e-06aa7ea947f1 tempest-SnapshotMetadataTestJSON-123221891 None] Created reservations ['23390e16-c742-4caf-8a99-345afc68cdb8', '486c3ebe-cf79-421a-9c63-d042beaa996d', '38a64333-9a4f-4634-a0f8-aa63ce34ef14', 'cf30420c-c0d7-4fe5-8a33-b274491c97fd'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:42:34 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-2a213d15-992a-490c-8f9e-06aa7ea947f1 tempest-SnapshotMetadataTestJSON-123221891 None] Delete snapshot completed successfully. Jul 17 19:42:34 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2a213d15-992a-490c-8f9e-06aa7ea947f1 tempest-SnapshotMetadataTestJSON-123221891 None] Lock "cinder-88b2a306-7b7a-4c5c-83aa-1c8cd2c325dc-delete_snapshot" released by "delete_snapshot" :: held 4.666s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:42:34 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5b0a11f1-9ce0-4751-a34d-5df23779efe1" returned: 0 in 6.474s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:34 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b78409-b21f-4cc7-a6d4-9f5b6205b6ce]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:42:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:34 devstack sudo[93931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3 Jul 17 19:42:34 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:35 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e53e4211-d877-47c1-a1a5-3e1045172ea2 tempest-SnapshotMetadataTestJSON-123221891 None] Acquiring lock "cinder-57789875-3b7d-4853-9fa6-6f1ab65993e9-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:42:35 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e53e4211-d877-47c1-a1a5-3e1045172ea2 tempest-SnapshotMetadataTestJSON-123221891 None] Lock "cinder-57789875-3b7d-4853-9fa6-6f1ab65993e9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:42:35 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3" returned: 0 in 0.545s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:35 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Image conversion details: src /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3, size 1024.00 MB, duration 6.48 sec, destination /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5b0a11f1-9ce0-4751-a34d-5df23779efe1 {{(pid=87726) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 19:42:35 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Converted 1024.00 MB image at 158.13 MB/s Jul 17 19:42:35 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5b0a11f1-9ce0-4751-a34d-5df23779efe1 is being set with open permissions: ugo+rw Jul 17 19:42:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5b0a11f1-9ce0-4751-a34d-5df23779efe1 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:35 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e53e4211-d877-47c1-a1a5-3e1045172ea2 tempest-SnapshotMetadataTestJSON-123221891 None] Acquiring lock "cinder-quobyte-57789875-3b7d-4853-9fa6-6f1ab65993e9" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:42:35 devstack sudo[93936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5b0a11f1-9ce0-4751-a34d-5df23779efe1 Jul 17 19:42:35 devstack sudo[93936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:35 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e53e4211-d877-47c1-a1a5-3e1045172ea2 tempest-SnapshotMetadataTestJSON-123221891 None] Lock "cinder-quobyte-57789875-3b7d-4853-9fa6-6f1ab65993e9" acquired by "delete_volume" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:42:35 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c113e53-d4e0-4fae-b844-147fca435570]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:42:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e53e4211-d877-47c1-a1a5-3e1045172ea2 tempest-SnapshotMetadataTestJSON-123221891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:35 devstack sudo[93938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9 Jul 17 19:42:35 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:35 devstack sudo[93936]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5b0a11f1-9ce0-4751-a34d-5df23779efe1" returned: 0 in 0.254s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:35 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-quobyte-5b0a11f1-9ce0-4751-a34d-5df23779efe1" released by "_copy_volume_from_snapshot" :: held 8.153s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:42:35 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-quobyte-dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f-5b0a11f1-9ce0-4751-a34d-5df23779efe1" released by "_create_volume_from_snapshot" :: held 8.191s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:42:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.218s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:42:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f18b3c-450d-454e-b75e-9a3869abc816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b0a11f1-9ce0-4751-a34d-5df23779efe1', 'volume_size': 1, 'snapshot_id': 'dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f'}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (474470fb-a3b0-4319-a58b-cda9af78bca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:35 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Volume volume-5b0a11f1-9ce0-4751-a34d-5df23779efe1 (5b0a11f1-9ce0-4751-a34d-5df23779efe1): created successfully Jul 17 19:42:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (474470fb-a3b0-4319-a58b-cda9af78bca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Flow 'volume_create_manager' (69a317c6-fd1e-4800-99c4-2855462126d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:42:35 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-7d9246c3-f0f1-4755-b958-f93a138b63f9 tempest-VolumesDeleteCascade-2136189065 None] Created volume successfully. Jul 17 19:42:35 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e53e4211-d877-47c1-a1a5-3e1045172ea2 tempest-SnapshotMetadataTestJSON-123221891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9" returned: 0 in 0.384s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e53e4211-d877-47c1-a1a5-3e1045172ea2 tempest-SnapshotMetadataTestJSON-123221891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:35 devstack sudo[93946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9 Jul 17 19:42:35 devstack sudo[93946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:36 devstack sudo[93946]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e53e4211-d877-47c1-a1a5-3e1045172ea2 tempest-SnapshotMetadataTestJSON-123221891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-57789875-3b7d-4853-9fa6-6f1ab65993e9" returned: 0 in 0.247s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e53e4211-d877-47c1-a1a5-3e1045172ea2 tempest-SnapshotMetadataTestJSON-123221891 None] Lock "cinder-quobyte-57789875-3b7d-4853-9fa6-6f1ab65993e9" released by "delete_volume" :: held 0.694s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-e53e4211-d877-47c1-a1a5-3e1045172ea2 tempest-SnapshotMetadataTestJSON-123221891 None] Created reservations ['cd1526b4-3fea-49f1-9c23-56e598bc3f05', '89440134-2480-4733-b8d6-d2ebac677013', '54367586-a3e8-4e0e-b50f-cd2bdc6dee42', 'ef3856e1-7bc0-4136-acc0-5ce480408ebd'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e53e4211-d877-47c1-a1a5-3e1045172ea2 tempest-SnapshotMetadataTestJSON-123221891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e53e4211-d877-47c1-a1a5-3e1045172ea2 tempest-SnapshotMetadataTestJSON-123221891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e53e4211-d877-47c1-a1a5-3e1045172ea2 tempest-SnapshotMetadataTestJSON-123221891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e53e4211-d877-47c1-a1a5-3e1045172ea2 tempest-SnapshotMetadataTestJSON-123221891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e53e4211-d877-47c1-a1a5-3e1045172ea2 tempest-SnapshotMetadataTestJSON-123221891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e53e4211-d877-47c1-a1a5-3e1045172ea2 tempest-SnapshotMetadataTestJSON-123221891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:36 devstack sudo[93949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:42:36 devstack sudo[93949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Acquiring lock "cinder-ace9569a-ab14-470b-8751-6f4507b867e3-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-ace9569a-ab14-470b-8751-6f4507b867e3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Performing cascade delete. {{(pid=87726) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Acquiring lock "cinder-dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Acquiring lock "cinder-quobyte-ace9569a-ab14-470b-8751-6f4507b867e3" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-quobyte-ace9569a-ab14-470b-8751-6f4507b867e3" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:42:36 devstack sudo[93949]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Acquiring lock "cinder-quobyte-dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e53e4211-d877-47c1-a1a5-3e1045172ea2 tempest-SnapshotMetadataTestJSON-123221891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.380s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-e53e4211-d877-47c1-a1a5-3e1045172ea2 tempest-SnapshotMetadataTestJSON-123221891 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:42:36 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e53e4211-d877-47c1-a1a5-3e1045172ea2 tempest-SnapshotMetadataTestJSON-123221891 None] Deleted volume successfully. Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-quobyte-dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Deleting offline snapshot dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f of volume ace9569a-ab14-470b-8751-6f4507b867e3 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] snapshot_file for this snap is: volume-ace9569a-ab14-470b-8751-6f4507b867e3.dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[03eb373c-81e9-461b-85d2-e055ff6fb52f]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3.dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e53e4211-d877-47c1-a1a5-3e1045172ea2 tempest-SnapshotMetadataTestJSON-123221891 None] Lock "cinder-57789875-3b7d-4853-9fa6-6f1ab65993e9-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] Flow 'volume_create_manager' (f19091fb-0dc1-4e4d-807f-716f6ca412a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80cb2a16-883e-4ec4-ad48-8c59a2561662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80cb2a16-883e-4ec4-ad48-8c59a2561662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1358654368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f7c736-277e-4e2f-853a-edf07815909e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab82e6259dfe4ca4a31155929f92bb85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:42:37Z,use_quota=True,user_id='697c8081cc3f4dc49485b7498a5ee100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6c1f78d-e9c5-4d6a-a035-64c7b2e65bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6c1f78d-e9c5-4d6a-a035-64c7b2e65bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9874983d-8da6-44e5-a811-ac2dc1649dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9874983d-8da6-44e5-a811-ac2dc1649dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15f7c736-277e-4e2f-853a-edf07815909e', 'volume_name': 'volume-15f7c736-277e-4e2f-853a-edf07815909e', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2f4082-af79-4490-a3ca-d99cb718d15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2f4082-af79-4490-a3ca-d99cb718d15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d1a4e7d-7c79-405b-9f47-075cfbbdd34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:36 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] Volume 15f7c736-277e-4e2f-853a-edf07815909e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15f7c736-277e-4e2f-853a-edf07815909e', 'volume_size': 1} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1358654368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f7c736-277e-4e2f-853a-edf07815909e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab82e6259dfe4ca4a31155929f92bb85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:42:37Z,use_quota=True,user_id='697c8081cc3f4dc49485b7498a5ee100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] Creating volume 15f7c736-277e-4e2f-853a-edf07815909e {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:42:36 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:42:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-15f7c736-277e-4e2f-853a-edf07815909e 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:36 devstack sudo[93952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3.dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f Jul 17 19:42:36 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:36 devstack sudo[93954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-15f7c736-277e-4e2f-853a-edf07815909e 1073741824 Jul 17 19:42:36 devstack sudo[93954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:37 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3.dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f" returned: 0 in 0.395s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ace9569a-ab14-470b-8751-6f4507b867e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:42:37 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[322ba4e5-c2d5-4408-b7bd-1999ce1d9b23]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:42:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:37 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3 Jul 17 19:42:37 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:37 devstack sudo[93954]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-15f7c736-277e-4e2f-853a-edf07815909e 1073741824" returned: 0 in 0.491s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-15f7c736-277e-4e2f-853a-edf07815909e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:37 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-15f7c736-277e-4e2f-853a-edf07815909e Jul 17 19:42:37 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:37 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3" returned: 0 in 0.438s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3.dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:37 devstack sudo[93972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3.dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f Jul 17 19:42:37 devstack sudo[93972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:37 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-15f7c736-277e-4e2f-853a-edf07815909e" returned: 0 in 0.303s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:42:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:42:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d1a4e7d-7c79-405b-9f47-075cfbbdd34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15f7c736-277e-4e2f-853a-edf07815909e', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85c05a89-abcc-4078-af52-89cd20319fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:37 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] Volume volume-15f7c736-277e-4e2f-853a-edf07815909e (15f7c736-277e-4e2f-853a-edf07815909e): created successfully Jul 17 19:42:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85c05a89-abcc-4078-af52-89cd20319fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] Flow 'volume_create_manager' (f19091fb-0dc1-4e4d-807f-716f6ca412a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:42:37 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-0b2e068c-62f1-4c89-b81c-ac6aed621f27 tempest-AttachVolumeNegativeTest-1875054094 None] Created volume successfully. Jul 17 19:42:37 devstack sudo[93972]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3.dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f" returned: 0 in 0.354s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3.dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:37 devstack sudo[93978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3.dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f Jul 17 19:42:37 devstack sudo[93978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:38 devstack sudo[93978]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3.dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f" returned: 0 in 0.249s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:38 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-quobyte-dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f" released by "_delete_snapshot" :: held 1.533s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:42:38 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-quobyte-ace9569a-ab14-470b-8751-6f4507b867e3" released by "delete_snapshot" :: held 1.574s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:42:38 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Created reservations ['7535c484-4e57-4cba-a593-13f768750a5a', '085743f0-43ed-41a3-9d23-fd966827d2e7', '6e0574db-b74a-46e3-9d14-8a48baab00e3', '2d20beb9-358e-4840-9804-b1fe4a2cdb99'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:42:38 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Delete snapshot completed successfully. Jul 17 19:42:38 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-dbf3010a-a54d-48c2-b9ed-e2fd3ea75c3f-delete_snapshot" released by "delete_snapshot" :: held 1.762s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:42:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Snapshots deleted, issuing volume delete {{(pid=87726) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 17 19:42:38 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Acquiring lock "cinder-quobyte-ace9569a-ab14-470b-8751-6f4507b867e3" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:42:38 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-quobyte-ace9569a-ab14-470b-8751-6f4507b867e3" acquired by "delete_volume" :: waited 0.013s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:42:38 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c501dca-3556-45e8-a42d-e78707aea3b7]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:42:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:38 devstack sudo[93981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3 Jul 17 19:42:38 devstack sudo[93981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:38 devstack sudo[93981]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3" returned: 0 in 0.400s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:38 devstack sudo[93990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3 Jul 17 19:42:38 devstack sudo[93990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:38 devstack sudo[93990]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ace9569a-ab14-470b-8751-6f4507b867e3" returned: 0 in 0.280s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:39 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-quobyte-ace9569a-ab14-470b-8751-6f4507b867e3" released by "delete_volume" :: held 0.746s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:42:39 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Created reservations ['060a081b-be3a-482a-b2c1-129096b3e30e', '016098fd-7da4-462d-a8c9-aadb960ec08b', '504e3c54-f2be-47d1-8d12-4df6756a9a12', 'd6f55290-6070-45b2-bf65-8161ff60359a'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:42:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:42:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:42:39 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:42:39 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:42:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:42:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:39 devstack sudo[93993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:42:39 devstack sudo[93993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:39 devstack sudo[93993]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.318s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:39 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:42:39 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Deleted volume successfully. Jul 17 19:42:39 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ec56074c-a543-46a3-8bee-b1bcd87c9346 tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-ace9569a-ab14-470b-8751-6f4507b867e3-delete_volume" released by "delete_volume" :: held 3.183s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:42:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-ae2370eb-02dc-4273-a3e3-71be30db3168 req-cfb3cccb-ed7d-4a1c-b235-8bc9aeb07198 tempest-AttachVolumeNegativeTest-1875054094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:42:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-ae2370eb-02dc-4273-a3e3-71be30db3168 req-cfb3cccb-ed7d-4a1c-b235-8bc9aeb07198 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:42:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-ae2370eb-02dc-4273-a3e3-71be30db3168 req-cfb3cccb-ed7d-4a1c-b235-8bc9aeb07198 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:42:39 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-ae2370eb-02dc-4273-a3e3-71be30db3168 req-cfb3cccb-ed7d-4a1c-b235-8bc9aeb07198 tempest-AttachVolumeNegativeTest-1875054094 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55', 'name': 'volume-15f7c736-277e-4e2f-853a-edf07815909e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '96830167-f906-4a15-976e-ef39eb5410f5', 'enforce_multipath': True} {{(pid=87726) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 19:42:39 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-ae2370eb-02dc-4273-a3e3-71be30db3168 req-cfb3cccb-ed7d-4a1c-b235-8bc9aeb07198 tempest-AttachVolumeNegativeTest-1875054094 None] attachment_update completed successfully. Jul 17 19:42:39 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-dcda2db1-465c-49f0-9b5d-de110e3aaee7 tempest-VolumesDeleteCascade-2136189065 None] Acquiring lock "cinder-5b0a11f1-9ce0-4751-a34d-5df23779efe1-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:42:39 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-dcda2db1-465c-49f0-9b5d-de110e3aaee7 tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-5b0a11f1-9ce0-4751-a34d-5df23779efe1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:42:40 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-dcda2db1-465c-49f0-9b5d-de110e3aaee7 tempest-VolumesDeleteCascade-2136189065 None] Acquiring lock "cinder-quobyte-5b0a11f1-9ce0-4751-a34d-5df23779efe1" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:42:40 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-dcda2db1-465c-49f0-9b5d-de110e3aaee7 tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-quobyte-5b0a11f1-9ce0-4751-a34d-5df23779efe1" acquired by "delete_volume" :: waited 0.024s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:42:40 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33d0675-7349-4600-a275-ad384c86e496]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:42:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dcda2db1-465c-49f0-9b5d-de110e3aaee7 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5b0a11f1-9ce0-4751-a34d-5df23779efe1 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:40 devstack sudo[94052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5b0a11f1-9ce0-4751-a34d-5df23779efe1 Jul 17 19:42:40 devstack sudo[94052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:40 devstack sudo[94052]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dcda2db1-465c-49f0-9b5d-de110e3aaee7 tempest-VolumesDeleteCascade-2136189065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5b0a11f1-9ce0-4751-a34d-5df23779efe1" returned: 0 in 0.539s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dcda2db1-465c-49f0-9b5d-de110e3aaee7 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5b0a11f1-9ce0-4751-a34d-5df23779efe1 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:40 devstack sudo[94394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5b0a11f1-9ce0-4751-a34d-5df23779efe1 Jul 17 19:42:40 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:41 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dcda2db1-465c-49f0-9b5d-de110e3aaee7 tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5b0a11f1-9ce0-4751-a34d-5df23779efe1" returned: 0 in 0.336s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:41 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-dcda2db1-465c-49f0-9b5d-de110e3aaee7 tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-quobyte-5b0a11f1-9ce0-4751-a34d-5df23779efe1" released by "delete_volume" :: held 0.953s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:42:41 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-dcda2db1-465c-49f0-9b5d-de110e3aaee7 tempest-VolumesDeleteCascade-2136189065 None] Created reservations ['2136abf5-5d1f-4618-8e28-9a54d4e767ae', '5f21c7a3-a63f-4c60-aab0-a7d493d02482', '328aa0d0-05fc-4c20-98c6-f5288ff5d9e3', '55cf498b-412a-4b21-8fe0-d12681aef1a7'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:42:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-dcda2db1-465c-49f0-9b5d-de110e3aaee7 tempest-VolumesDeleteCascade-2136189065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:42:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-dcda2db1-465c-49f0-9b5d-de110e3aaee7 tempest-VolumesDeleteCascade-2136189065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:42:41 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-dcda2db1-465c-49f0-9b5d-de110e3aaee7 tempest-VolumesDeleteCascade-2136189065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:42:41 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-dcda2db1-465c-49f0-9b5d-de110e3aaee7 tempest-VolumesDeleteCascade-2136189065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:42:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-dcda2db1-465c-49f0-9b5d-de110e3aaee7 tempest-VolumesDeleteCascade-2136189065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:42:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dcda2db1-465c-49f0-9b5d-de110e3aaee7 tempest-VolumesDeleteCascade-2136189065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:41 devstack sudo[94397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:42:41 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:41 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dcda2db1-465c-49f0-9b5d-de110e3aaee7 tempest-VolumesDeleteCascade-2136189065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.242s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:41 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-dcda2db1-465c-49f0-9b5d-de110e3aaee7 tempest-VolumesDeleteCascade-2136189065 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:42:41 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-dcda2db1-465c-49f0-9b5d-de110e3aaee7 tempest-VolumesDeleteCascade-2136189065 None] Deleted volume successfully. Jul 17 19:42:41 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-dcda2db1-465c-49f0-9b5d-de110e3aaee7 tempest-VolumesDeleteCascade-2136189065 None] Lock "cinder-5b0a11f1-9ce0-4751-a34d-5df23779efe1-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] Flow 'volume_create_manager' (f6700e8c-b034-4c51-86cd-d9812defb5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5efad02-4bc5-4653-83a9-ead7ec02be82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5efad02-4bc5-4653-83a9-ead7ec02be82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-571255719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f21ef10a-f14d-4495-a253-e2e28d2dcf5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdda1a0eaf1540d6871d8eea61b6a0e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:42:44Z,use_quota=True,user_id='e63aafdffa894a16b4a4b00866aba5e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b7546db-dda7-4505-8c0b-19b0f4dfd294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b7546db-dda7-4505-8c0b-19b0f4dfd294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb217998-c349-46a7-bc38-b965621dc71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb217998-c349-46a7-bc38-b965621dc71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f21ef10a-f14d-4495-a253-e2e28d2dcf5f', 'volume_name': 'volume-f21ef10a-f14d-4495-a253-e2e28d2dcf5f', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfcfd167-994f-4d9f-a841-1f50b46e115f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfcfd167-994f-4d9f-a841-1f50b46e115f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0422464-9fe4-4078-b3f2-d264c0b3142c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:44 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] Volume f21ef10a-f14d-4495-a253-e2e28d2dcf5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f21ef10a-f14d-4495-a253-e2e28d2dcf5f', 'volume_size': 1} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-571255719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f21ef10a-f14d-4495-a253-e2e28d2dcf5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdda1a0eaf1540d6871d8eea61b6a0e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:42:44Z,use_quota=True,user_id='e63aafdffa894a16b4a4b00866aba5e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] Creating volume f21ef10a-f14d-4495-a253-e2e28d2dcf5f {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:42:44 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f21ef10a-f14d-4495-a253-e2e28d2dcf5f 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:44 devstack sudo[94407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f21ef10a-f14d-4495-a253-e2e28d2dcf5f 1073741824 Jul 17 19:42:44 devstack sudo[94407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] Flow 'volume_create_manager' (4d7c7843-a697-4544-920b-067b953719ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5572f866-de75-49b8-9a16-ab027885a5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5572f866-de75-49b8-9a16-ab027885a5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1587528296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a6e7753-3e6b-4a3f-8e47-f254202072b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3eb231eeee04b54a8c6f172af2aefbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:42:44Z,use_quota=True,user_id='4a89a3659430460d8064465cc1ef4b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f28dd937-b2f8-4055-af1d-8cd4fc76447c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f28dd937-b2f8-4055-af1d-8cd4fc76447c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (776bd57e-da62-43d2-967b-2494efc639c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (776bd57e-da62-43d2-967b-2494efc639c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a6e7753-3e6b-4a3f-8e47-f254202072b9', 'volume_name': 'volume-9a6e7753-3e6b-4a3f-8e47-f254202072b9', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05fd0bee-1c15-4fcb-9ba2-a6122c23f3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05fd0bee-1c15-4fcb-9ba2-a6122c23f3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb7c29e8-ac7e-4188-a16f-a7f568ed032b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:44 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] Volume 9a6e7753-3e6b-4a3f-8e47-f254202072b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a6e7753-3e6b-4a3f-8e47-f254202072b9', 'volume_size': 1} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:42:44 devstack sudo[94407]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f21ef10a-f14d-4495-a253-e2e28d2dcf5f 1073741824" returned: 0 in 0.507s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f21ef10a-f14d-4495-a253-e2e28d2dcf5f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:44 devstack sudo[94413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f21ef10a-f14d-4495-a253-e2e28d2dcf5f Jul 17 19:42:44 devstack sudo[94413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:45 devstack sudo[94413]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f21ef10a-f14d-4495-a253-e2e28d2dcf5f" returned: 0 in 0.279s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:45 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:42:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:42:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.728s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:42:45 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1587528296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a6e7753-3e6b-4a3f-8e47-f254202072b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3eb231eeee04b54a8c6f172af2aefbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:42:44Z,use_quota=True,user_id='4a89a3659430460d8064465cc1ef4b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:42:45 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] Creating volume 9a6e7753-3e6b-4a3f-8e47-f254202072b9 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:42:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:42:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:42:45 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:42:45 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:42:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:42:45 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:42:45 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:42:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9a6e7753-3e6b-4a3f-8e47-f254202072b9 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0422464-9fe4-4078-b3f2-d264c0b3142c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f21ef10a-f14d-4495-a253-e2e28d2dcf5f', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:45 devstack sudo[94429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9a6e7753-3e6b-4a3f-8e47-f254202072b9 1073741824 Jul 17 19:42:45 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cca7155-5eed-4571-b7b0-775336b8146b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:45 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] Volume volume-f21ef10a-f14d-4495-a253-e2e28d2dcf5f (f21ef10a-f14d-4495-a253-e2e28d2dcf5f): created successfully Jul 17 19:42:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cca7155-5eed-4571-b7b0-775336b8146b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] Flow 'volume_create_manager' (f6700e8c-b034-4c51-86cd-d9812defb5b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:42:45 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-89555f70-c57b-46cf-9bb5-418fbe360718 tempest-AttachVolumeTestJSON-1460626915 None] Created volume successfully. Jul 17 19:42:45 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9a6e7753-3e6b-4a3f-8e47-f254202072b9 1073741824" returned: 0 in 0.633s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9a6e7753-3e6b-4a3f-8e47-f254202072b9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:45 devstack sudo[94462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9a6e7753-3e6b-4a3f-8e47-f254202072b9 Jul 17 19:42:45 devstack sudo[94462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:46 devstack sudo[94462]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9a6e7753-3e6b-4a3f-8e47-f254202072b9" returned: 0 in 0.323s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:46 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:42:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:42:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb7c29e8-ac7e-4188-a16f-a7f568ed032b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a6e7753-3e6b-4a3f-8e47-f254202072b9', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd14e47c-ccd7-4444-8160-973a44fee4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:46 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] Volume volume-9a6e7753-3e6b-4a3f-8e47-f254202072b9 (9a6e7753-3e6b-4a3f-8e47-f254202072b9): created successfully Jul 17 19:42:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd14e47c-ccd7-4444-8160-973a44fee4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] Flow 'volume_create_manager' (4d7c7843-a697-4544-920b-067b953719ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:42:46 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-a6eb2104-03cc-4ecd-9d74-c873b8d27142 tempest-AbsoluteLimitsTests-1688009360 None] Created volume successfully. Jul 17 19:42:46 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:42:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] Flow 'volume_create_manager' (f2a15c49-53a7-4d76-ac41-934c80a4bd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:42:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f35d6532-ea1c-4cfb-9187-1fd6b5657f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f35d6532-ea1c-4cfb-9187-1fd6b5657f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-160098187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a06f828-15e5-4252-b4c9-74a72a650472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f90fea9d2854bf0be4b61b6e6c978cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:42:46Z,use_quota=True,user_id='80c9e7e30ba4437d86642b1185a8666e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ee48d97-fe28-4d14-874e-2e43c58b9266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ee48d97-fe28-4d14-874e-2e43c58b9266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc092398-b13b-4915-8f23-4699069d91d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc092398-b13b-4915-8f23-4699069d91d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a06f828-15e5-4252-b4c9-74a72a650472', 'volume_name': 'volume-4a06f828-15e5-4252-b4c9-74a72a650472', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (000a84fb-c45d-4226-b699-238a969c6c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (000a84fb-c45d-4226-b699-238a969c6c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea7a77cd-0df3-430e-a37d-259227675b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:46 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] Volume 4a06f828-15e5-4252-b4c9-74a72a650472: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a06f828-15e5-4252-b4c9-74a72a650472', 'volume_size': 1} Jul 17 19:42:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:42:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:42:46 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-160098187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a06f828-15e5-4252-b4c9-74a72a650472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f90fea9d2854bf0be4b61b6e6c978cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:42:46Z,use_quota=True,user_id='80c9e7e30ba4437d86642b1185a8666e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:42:46 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] Creating volume 4a06f828-15e5-4252-b4c9-74a72a650472 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:42:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:42:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:42:46 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:42:46 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:42:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:42:46 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:42:46 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:42:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4a06f828-15e5-4252-b4c9-74a72a650472 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:46 devstack sudo[94469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4a06f828-15e5-4252-b4c9-74a72a650472 1073741824 Jul 17 19:42:46 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-0f7dd818-0a0b-4451-bd9c-2121de31b72d req-2d35e23c-9657-4ba2-a90e-f4ae426c715f tempest-AttachVolumeTestJSON-1460626915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:42:47 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4a06f828-15e5-4252-b4c9-74a72a650472 1073741824" returned: 0 in 0.569s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4a06f828-15e5-4252-b4c9-74a72a650472 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:47 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4a06f828-15e5-4252-b4c9-74a72a650472 Jul 17 19:42:47 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:47 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4a06f828-15e5-4252-b4c9-74a72a650472" returned: 0 in 0.321s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:47 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:42:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:42:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-0f7dd818-0a0b-4451-bd9c-2121de31b72d req-2d35e23c-9657-4ba2-a90e-f4ae426c715f tempest-AttachVolumeTestJSON-1460626915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.455s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:42:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-0f7dd818-0a0b-4451-bd9c-2121de31b72d req-2d35e23c-9657-4ba2-a90e-f4ae426c715f tempest-AttachVolumeTestJSON-1460626915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:42:47 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea7a77cd-0df3-430e-a37d-259227675b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a06f828-15e5-4252-b4c9-74a72a650472', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:47 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a868eed-6bbd-470f-bbb6-5e325d3ae8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-b1fdf185-a97f-4af7-a12c-1a11a824ca6f tempest-AbsoluteLimitsTests-1688009360 None] Acquiring lock "cinder-9a6e7753-3e6b-4a3f-8e47-f254202072b9-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:42:47 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] Volume volume-4a06f828-15e5-4252-b4c9-74a72a650472 (4a06f828-15e5-4252-b4c9-74a72a650472): created successfully Jul 17 19:42:47 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a868eed-6bbd-470f-bbb6-5e325d3ae8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:47 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] Flow 'volume_create_manager' (f2a15c49-53a7-4d76-ac41-934c80a4bd32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:42:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-b1fdf185-a97f-4af7-a12c-1a11a824ca6f tempest-AbsoluteLimitsTests-1688009360 None] Lock "cinder-9a6e7753-3e6b-4a3f-8e47-f254202072b9-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:42:47 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-906fd3c3-36cc-4da4-a09d-2d408b202587 tempest-VolumesMetadataTest-925453478 None] Created volume successfully. Jul 17 19:42:47 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-0f7dd818-0a0b-4451-bd9c-2121de31b72d req-2d35e23c-9657-4ba2-a90e-f4ae426c715f tempest-AttachVolumeTestJSON-1460626915 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55', 'name': 'volume-f21ef10a-f14d-4495-a253-e2e28d2dcf5f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a92f6cf-8df5-4f3c-8f8e-a742f4f34a49', 'enforce_multipath': True} {{(pid=87726) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 19:42:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-b1fdf185-a97f-4af7-a12c-1a11a824ca6f tempest-AbsoluteLimitsTests-1688009360 None] Acquiring lock "cinder-quobyte-9a6e7753-3e6b-4a3f-8e47-f254202072b9" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:42:47 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-0f7dd818-0a0b-4451-bd9c-2121de31b72d req-2d35e23c-9657-4ba2-a90e-f4ae426c715f tempest-AttachVolumeTestJSON-1460626915 None] attachment_update completed successfully. Jul 17 19:42:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-b1fdf185-a97f-4af7-a12c-1a11a824ca6f tempest-AbsoluteLimitsTests-1688009360 None] Lock "cinder-quobyte-9a6e7753-3e6b-4a3f-8e47-f254202072b9" acquired by "delete_volume" :: waited 0.040s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:42:47 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c675f79-07e2-4068-a999-ff195ec484da]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:42:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b1fdf185-a97f-4af7-a12c-1a11a824ca6f tempest-AbsoluteLimitsTests-1688009360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9a6e7753-3e6b-4a3f-8e47-f254202072b9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:48 devstack sudo[94504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9a6e7753-3e6b-4a3f-8e47-f254202072b9 Jul 17 19:42:48 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:48 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b1fdf185-a97f-4af7-a12c-1a11a824ca6f tempest-AbsoluteLimitsTests-1688009360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9a6e7753-3e6b-4a3f-8e47-f254202072b9" returned: 0 in 0.479s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b1fdf185-a97f-4af7-a12c-1a11a824ca6f tempest-AbsoluteLimitsTests-1688009360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9a6e7753-3e6b-4a3f-8e47-f254202072b9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:48 devstack sudo[94511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9a6e7753-3e6b-4a3f-8e47-f254202072b9 Jul 17 19:42:48 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:48 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b1fdf185-a97f-4af7-a12c-1a11a824ca6f tempest-AbsoluteLimitsTests-1688009360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9a6e7753-3e6b-4a3f-8e47-f254202072b9" returned: 0 in 0.350s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:48 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-b1fdf185-a97f-4af7-a12c-1a11a824ca6f tempest-AbsoluteLimitsTests-1688009360 None] Lock "cinder-quobyte-9a6e7753-3e6b-4a3f-8e47-f254202072b9" released by "delete_volume" :: held 0.938s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:42:48 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:UPDATE=99,cinder:SELECT=90,cinder:INSERT=26,cinder:DELETE=12 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:42:48 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=97,cinder:UPDATE=96,cinder:INSERT=21,cinder:DELETE=6 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:42:48 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-b1fdf185-a97f-4af7-a12c-1a11a824ca6f tempest-AbsoluteLimitsTests-1688009360 None] Created reservations ['eecb9c4c-324b-4423-bec3-79fedfa2a816', 'ec2ba407-ec3e-4a1f-96c7-47bd4a88ecef', '2cf13219-80d0-4e4b-ad8a-30f8c4e3ebdf', 'd82b4fa6-5711-4ad4-a3e5-a884b8a4cece'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:42:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b1fdf185-a97f-4af7-a12c-1a11a824ca6f tempest-AbsoluteLimitsTests-1688009360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:42:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b1fdf185-a97f-4af7-a12c-1a11a824ca6f tempest-AbsoluteLimitsTests-1688009360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:42:48 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b1fdf185-a97f-4af7-a12c-1a11a824ca6f tempest-AbsoluteLimitsTests-1688009360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:42:48 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b1fdf185-a97f-4af7-a12c-1a11a824ca6f tempest-AbsoluteLimitsTests-1688009360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:42:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b1fdf185-a97f-4af7-a12c-1a11a824ca6f tempest-AbsoluteLimitsTests-1688009360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:42:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b1fdf185-a97f-4af7-a12c-1a11a824ca6f tempest-AbsoluteLimitsTests-1688009360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:49 devstack sudo[94514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:42:49 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:49 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b1fdf185-a97f-4af7-a12c-1a11a824ca6f tempest-AbsoluteLimitsTests-1688009360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.419s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:49 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-b1fdf185-a97f-4af7-a12c-1a11a824ca6f tempest-AbsoluteLimitsTests-1688009360 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:42:49 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-b1fdf185-a97f-4af7-a12c-1a11a824ca6f tempest-AbsoluteLimitsTests-1688009360 None] Deleted volume successfully. Jul 17 19:42:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-b1fdf185-a97f-4af7-a12c-1a11a824ca6f tempest-AbsoluteLimitsTests-1688009360 None] Lock "cinder-9a6e7753-3e6b-4a3f-8e47-f254202072b9-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:42:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-dbfe7262-2cf0-44b8-9364-c8360db6d1bf tempest-VolumesMetadataTest-925453478 None] Acquiring lock "cinder-4a06f828-15e5-4252-b4c9-74a72a650472-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:42:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-dbfe7262-2cf0-44b8-9364-c8360db6d1bf tempest-VolumesMetadataTest-925453478 None] Lock "cinder-4a06f828-15e5-4252-b4c9-74a72a650472-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:42:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-dbfe7262-2cf0-44b8-9364-c8360db6d1bf tempest-VolumesMetadataTest-925453478 None] Acquiring lock "cinder-quobyte-4a06f828-15e5-4252-b4c9-74a72a650472" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:42:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-dbfe7262-2cf0-44b8-9364-c8360db6d1bf tempest-VolumesMetadataTest-925453478 None] Lock "cinder-quobyte-4a06f828-15e5-4252-b4c9-74a72a650472" acquired by "delete_volume" :: waited 0.027s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:42:49 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2990bec-9996-4e5e-b1b5-3c0d3f895078]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:42:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dbfe7262-2cf0-44b8-9364-c8360db6d1bf tempest-VolumesMetadataTest-925453478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4a06f828-15e5-4252-b4c9-74a72a650472 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:49 devstack sudo[94525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4a06f828-15e5-4252-b4c9-74a72a650472 Jul 17 19:42:49 devstack sudo[94525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:50 devstack sudo[94525]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dbfe7262-2cf0-44b8-9364-c8360db6d1bf tempest-VolumesMetadataTest-925453478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4a06f828-15e5-4252-b4c9-74a72a650472" returned: 0 in 0.523s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dbfe7262-2cf0-44b8-9364-c8360db6d1bf tempest-VolumesMetadataTest-925453478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4a06f828-15e5-4252-b4c9-74a72a650472 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:50 devstack sudo[94544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4a06f828-15e5-4252-b4c9-74a72a650472 Jul 17 19:42:50 devstack sudo[94544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:50 devstack sudo[94544]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dbfe7262-2cf0-44b8-9364-c8360db6d1bf tempest-VolumesMetadataTest-925453478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4a06f828-15e5-4252-b4c9-74a72a650472" returned: 0 in 0.563s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:50 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-dbfe7262-2cf0-44b8-9364-c8360db6d1bf tempest-VolumesMetadataTest-925453478 None] Lock "cinder-quobyte-4a06f828-15e5-4252-b4c9-74a72a650472" released by "delete_volume" :: held 1.165s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:42:50 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-dbfe7262-2cf0-44b8-9364-c8360db6d1bf tempest-VolumesMetadataTest-925453478 None] Created reservations ['6a039f37-6af9-43ec-bb7f-72424bf3eb6d', '1fe451e7-b2af-44d7-b663-d4749d8ea06a', 'ece907ed-70dc-4bd3-b452-4bbb08382c64', '57367fa3-b7ae-4ae9-b241-3af08986c400'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:42:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-dbfe7262-2cf0-44b8-9364-c8360db6d1bf tempest-VolumesMetadataTest-925453478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:42:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-dbfe7262-2cf0-44b8-9364-c8360db6d1bf tempest-VolumesMetadataTest-925453478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:42:51 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-dbfe7262-2cf0-44b8-9364-c8360db6d1bf tempest-VolumesMetadataTest-925453478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:42:51 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-dbfe7262-2cf0-44b8-9364-c8360db6d1bf tempest-VolumesMetadataTest-925453478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:42:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-dbfe7262-2cf0-44b8-9364-c8360db6d1bf tempest-VolumesMetadataTest-925453478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:42:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dbfe7262-2cf0-44b8-9364-c8360db6d1bf tempest-VolumesMetadataTest-925453478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:51 devstack sudo[94576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:42:51 devstack sudo[94576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:51 devstack sudo[94576]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dbfe7262-2cf0-44b8-9364-c8360db6d1bf tempest-VolumesMetadataTest-925453478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.409s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:51 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-dbfe7262-2cf0-44b8-9364-c8360db6d1bf tempest-VolumesMetadataTest-925453478 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:42:51 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-dbfe7262-2cf0-44b8-9364-c8360db6d1bf tempest-VolumesMetadataTest-925453478 None] Deleted volume successfully. Jul 17 19:42:51 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-dbfe7262-2cf0-44b8-9364-c8360db6d1bf tempest-VolumesMetadataTest-925453478 None] Lock "cinder-4a06f828-15e5-4252-b4c9-74a72a650472-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:42:58 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:42:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] Flow 'volume_create_manager' (887a4055-9862-4a13-9f6c-8e1375d1487c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:42:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecfd2b1f-ff1d-4af0-ab82-7552c50d5bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecfd2b1f-ff1d-4af0-ab82-7552c50d5bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1377273107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aa7ff16-85fe-4b11-8eb3-5a52428ad0bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51a0eac1e04a4365bd5332f47a30665c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:42:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:42:58Z,use_quota=True,user_id='77b1ea75231a4874ac36bb5f80e1d6f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (027b9804-8c4d-4cda-a70f-36b2e1ec972e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (027b9804-8c4d-4cda-a70f-36b2e1ec972e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00ecdaf9-d944-4eb6-8136-d65de45b8037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00ecdaf9-d944-4eb6-8136-d65de45b8037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aa7ff16-85fe-4b11-8eb3-5a52428ad0bf', 'volume_name': 'volume-7aa7ff16-85fe-4b11-8eb3-5a52428ad0bf', 'volume_size': 2}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c174955d-bf09-4432-b601-d6fdb9502f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c174955d-bf09-4432-b601-d6fdb9502f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:42:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e550d5a-4e8e-420d-84db-24dfa994c5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:42:58 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] Volume 7aa7ff16-85fe-4b11-8eb3-5a52428ad0bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aa7ff16-85fe-4b11-8eb3-5a52428ad0bf', 'volume_size': 2} Jul 17 19:42:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:42:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:42:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1377273107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aa7ff16-85fe-4b11-8eb3-5a52428ad0bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51a0eac1e04a4365bd5332f47a30665c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:42:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:42:58Z,use_quota=True,user_id='77b1ea75231a4874ac36bb5f80e1d6f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:42:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] Creating volume 7aa7ff16-85fe-4b11-8eb3-5a52428ad0bf {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:42:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:42:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:42:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:42:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:42:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:42:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:42:58 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:42:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7aa7ff16-85fe-4b11-8eb3-5a52428ad0bf 2147483648 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:58 devstack sudo[94692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7aa7ff16-85fe-4b11-8eb3-5a52428ad0bf 2147483648 Jul 17 19:42:58 devstack sudo[94692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:42:59 devstack sudo[94692]: pam_unix(sudo:session): session closed for user root Jul 17 19:42:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7aa7ff16-85fe-4b11-8eb3-5a52428ad0bf 2147483648" returned: 0 in 1.010s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:42:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7aa7ff16-85fe-4b11-8eb3-5a52428ad0bf {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:42:59 devstack sudo[94703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7aa7ff16-85fe-4b11-8eb3-5a52428ad0bf Jul 17 19:42:59 devstack sudo[94703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:00 devstack sudo[94703]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7aa7ff16-85fe-4b11-8eb3-5a52428ad0bf" returned: 0 in 0.468s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:00 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:43:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e550d5a-4e8e-420d-84db-24dfa994c5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aa7ff16-85fe-4b11-8eb3-5a52428ad0bf', 'volume_size': 2}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a58bf6-3c4e-464f-89e4-de49239b6bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:00 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] Volume volume-7aa7ff16-85fe-4b11-8eb3-5a52428ad0bf (7aa7ff16-85fe-4b11-8eb3-5a52428ad0bf): created successfully Jul 17 19:43:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a58bf6-3c4e-464f-89e4-de49239b6bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] Flow 'volume_create_manager' (887a4055-9862-4a13-9f6c-8e1375d1487c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:43:00 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-5946a998-898e-497a-b3d2-4cc83339fd96 tempest-VolumesCloneNegativeTest-977788879 None] Created volume successfully. Jul 17 19:43:00 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5ac8a9aa-b5fb-4fb2-b37d-856547a4babd tempest-VolumesCloneNegativeTest-977788879 None] Acquiring lock "cinder-7aa7ff16-85fe-4b11-8eb3-5a52428ad0bf-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:00 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5ac8a9aa-b5fb-4fb2-b37d-856547a4babd tempest-VolumesCloneNegativeTest-977788879 None] Lock "cinder-7aa7ff16-85fe-4b11-8eb3-5a52428ad0bf-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:01 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5ac8a9aa-b5fb-4fb2-b37d-856547a4babd tempest-VolumesCloneNegativeTest-977788879 None] Acquiring lock "cinder-quobyte-7aa7ff16-85fe-4b11-8eb3-5a52428ad0bf" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:01 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5ac8a9aa-b5fb-4fb2-b37d-856547a4babd tempest-VolumesCloneNegativeTest-977788879 None] Lock "cinder-quobyte-7aa7ff16-85fe-4b11-8eb3-5a52428ad0bf" acquired by "delete_volume" :: waited 0.036s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:01 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fd1da4-82e6-419b-8e7c-a1395f81a765]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:43:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5ac8a9aa-b5fb-4fb2-b37d-856547a4babd tempest-VolumesCloneNegativeTest-977788879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7aa7ff16-85fe-4b11-8eb3-5a52428ad0bf {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:01 devstack sudo[94730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7aa7ff16-85fe-4b11-8eb3-5a52428ad0bf Jul 17 19:43:01 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:01 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5ac8a9aa-b5fb-4fb2-b37d-856547a4babd tempest-VolumesCloneNegativeTest-977788879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7aa7ff16-85fe-4b11-8eb3-5a52428ad0bf" returned: 0 in 0.493s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5ac8a9aa-b5fb-4fb2-b37d-856547a4babd tempest-VolumesCloneNegativeTest-977788879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7aa7ff16-85fe-4b11-8eb3-5a52428ad0bf {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:01 devstack sudo[94735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7aa7ff16-85fe-4b11-8eb3-5a52428ad0bf Jul 17 19:43:01 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:01 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:43:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] Flow 'volume_create_manager' (7153a712-ef79-408b-b0f0-9d84213b34bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:43:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b900b49-aab7-41ab-9eb8-c7525d08b1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b900b49-aab7-41ab-9eb8-c7525d08b1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1614259539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebcc0ba9-9a36-4fa5-9660-aefba848aa9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb4ab296a442419cb7a4f7f152b77b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:43:02Z,use_quota=True,user_id='3e2f4f4cf1094df89af8bb5320ae06b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0674b57a-7b86-47d8-a281-60b037959b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0674b57a-7b86-47d8-a281-60b037959b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0636de1c-dab4-4be8-b039-f2fc279beeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0636de1c-dab4-4be8-b039-f2fc279beeab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebcc0ba9-9a36-4fa5-9660-aefba848aa9a', 'volume_name': 'volume-ebcc0ba9-9a36-4fa5-9660-aefba848aa9a', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7cca3cb-dd05-4e71-bd23-b6ed5885135d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7cca3cb-dd05-4e71-bd23-b6ed5885135d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f103cea9-e6e5-4944-a460-16065254d4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:01 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] Volume ebcc0ba9-9a36-4fa5-9660-aefba848aa9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebcc0ba9-9a36-4fa5-9660-aefba848aa9a', 'volume_size': 1} Jul 17 19:43:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:01 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1614259539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebcc0ba9-9a36-4fa5-9660-aefba848aa9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb4ab296a442419cb7a4f7f152b77b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:43:02Z,use_quota=True,user_id='3e2f4f4cf1094df89af8bb5320ae06b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:43:01 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] Creating volume ebcc0ba9-9a36-4fa5-9660-aefba848aa9a {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:43:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:01 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:43:01 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:43:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:01 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:43:01 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:43:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ebcc0ba9-9a36-4fa5-9660-aefba848aa9a 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:01 devstack sudo[94737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ebcc0ba9-9a36-4fa5-9660-aefba848aa9a 1073741824 Jul 17 19:43:01 devstack sudo[94737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:02 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5ac8a9aa-b5fb-4fb2-b37d-856547a4babd tempest-VolumesCloneNegativeTest-977788879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7aa7ff16-85fe-4b11-8eb3-5a52428ad0bf" returned: 0 in 0.324s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:02 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5ac8a9aa-b5fb-4fb2-b37d-856547a4babd tempest-VolumesCloneNegativeTest-977788879 None] Lock "cinder-quobyte-7aa7ff16-85fe-4b11-8eb3-5a52428ad0bf" released by "delete_volume" :: held 0.893s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:43:02 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-5ac8a9aa-b5fb-4fb2-b37d-856547a4babd tempest-VolumesCloneNegativeTest-977788879 None] Created reservations ['1f0e9029-585a-4832-9da7-1fcab136c7a1', 'e4770606-d2a3-4a1d-b98e-25e1f9ad2fbc', '6a7d8e7c-9a2f-4b0e-9195-f6e2fd9c5709', '95b12b1e-80fa-43c8-8b6e-b078f9405db7'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:43:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5ac8a9aa-b5fb-4fb2-b37d-856547a4babd tempest-VolumesCloneNegativeTest-977788879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5ac8a9aa-b5fb-4fb2-b37d-856547a4babd tempest-VolumesCloneNegativeTest-977788879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:02 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5ac8a9aa-b5fb-4fb2-b37d-856547a4babd tempest-VolumesCloneNegativeTest-977788879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:43:02 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5ac8a9aa-b5fb-4fb2-b37d-856547a4babd tempest-VolumesCloneNegativeTest-977788879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:43:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5ac8a9aa-b5fb-4fb2-b37d-856547a4babd tempest-VolumesCloneNegativeTest-977788879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5ac8a9aa-b5fb-4fb2-b37d-856547a4babd tempest-VolumesCloneNegativeTest-977788879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:02 devstack sudo[94743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:43:02 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:02 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5ac8a9aa-b5fb-4fb2-b37d-856547a4babd tempest-VolumesCloneNegativeTest-977788879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.308s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:02 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-5ac8a9aa-b5fb-4fb2-b37d-856547a4babd tempest-VolumesCloneNegativeTest-977788879 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:43:02 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-5ac8a9aa-b5fb-4fb2-b37d-856547a4babd tempest-VolumesCloneNegativeTest-977788879 None] Deleted volume successfully. Jul 17 19:43:02 devstack sudo[94737]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:02 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5ac8a9aa-b5fb-4fb2-b37d-856547a4babd tempest-VolumesCloneNegativeTest-977788879 None] Lock "cinder-7aa7ff16-85fe-4b11-8eb3-5a52428ad0bf-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:43:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ebcc0ba9-9a36-4fa5-9660-aefba848aa9a 1073741824" returned: 0 in 0.696s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ebcc0ba9-9a36-4fa5-9660-aefba848aa9a {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:02 devstack sudo[94747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ebcc0ba9-9a36-4fa5-9660-aefba848aa9a Jul 17 19:43:02 devstack sudo[94747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:02 devstack sudo[94747]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ebcc0ba9-9a36-4fa5-9660-aefba848aa9a" returned: 0 in 0.335s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:02 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:43:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:02 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f103cea9-e6e5-4944-a460-16065254d4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebcc0ba9-9a36-4fa5-9660-aefba848aa9a', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:02 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc50991-522d-4b94-bff3-d329940d36b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:03 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] Volume volume-ebcc0ba9-9a36-4fa5-9660-aefba848aa9a (ebcc0ba9-9a36-4fa5-9660-aefba848aa9a): created successfully Jul 17 19:43:03 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc50991-522d-4b94-bff3-d329940d36b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:03 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] Flow 'volume_create_manager' (7153a712-ef79-408b-b0f0-9d84213b34bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:43:03 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-92627cb8-9023-4a0f-aba9-e7998d424918 tempest-VolumesTransfersV355Test-1823254717 None] Created volume successfully. Jul 17 19:43:04 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-07206907-9872-4c1a-8623-7bbfd6383b6a tempest-VolumesTransfersV355Test-940448404 None] Transfer volume completed successfully. Jul 17 19:43:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-445bb137-6b24-474b-a9de-f47be19149be tempest-VolumesTransfersV355Test-224329213 None] Acquiring lock "cinder-ebcc0ba9-9a36-4fa5-9660-aefba848aa9a-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-445bb137-6b24-474b-a9de-f47be19149be tempest-VolumesTransfersV355Test-224329213 None] Lock "cinder-ebcc0ba9-9a36-4fa5-9660-aefba848aa9a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-445bb137-6b24-474b-a9de-f47be19149be tempest-VolumesTransfersV355Test-224329213 None] Acquiring lock "cinder-quobyte-ebcc0ba9-9a36-4fa5-9660-aefba848aa9a" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-445bb137-6b24-474b-a9de-f47be19149be tempest-VolumesTransfersV355Test-224329213 None] Lock "cinder-quobyte-ebcc0ba9-9a36-4fa5-9660-aefba848aa9a" acquired by "delete_volume" :: waited 0.026s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:05 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9e82da-bba5-4625-8a40-e33a72b93124]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:43:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-445bb137-6b24-474b-a9de-f47be19149be tempest-VolumesTransfersV355Test-224329213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ebcc0ba9-9a36-4fa5-9660-aefba848aa9a {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:06 devstack sudo[94787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ebcc0ba9-9a36-4fa5-9660-aefba848aa9a Jul 17 19:43:06 devstack sudo[94787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:06 devstack sudo[94787]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-445bb137-6b24-474b-a9de-f47be19149be tempest-VolumesTransfersV355Test-224329213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ebcc0ba9-9a36-4fa5-9660-aefba848aa9a" returned: 0 in 0.464s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-445bb137-6b24-474b-a9de-f47be19149be tempest-VolumesTransfersV355Test-224329213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ebcc0ba9-9a36-4fa5-9660-aefba848aa9a {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:06 devstack sudo[94792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ebcc0ba9-9a36-4fa5-9660-aefba848aa9a Jul 17 19:43:06 devstack sudo[94792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:06 devstack sudo[94792]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-445bb137-6b24-474b-a9de-f47be19149be tempest-VolumesTransfersV355Test-224329213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ebcc0ba9-9a36-4fa5-9660-aefba848aa9a" returned: 0 in 0.315s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:06 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-445bb137-6b24-474b-a9de-f47be19149be tempest-VolumesTransfersV355Test-224329213 None] Lock "cinder-quobyte-ebcc0ba9-9a36-4fa5-9660-aefba848aa9a" released by "delete_volume" :: held 0.843s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:43:06 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:43:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Flow 'volume_create_manager' (ddb98510-255d-47b8-9e41-c89bb8f56608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:43:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d305f270-d89e-4179-81e1-366a1bb70473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d305f270-d89e-4179-81e1-366a1bb70473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-191010066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c45a321-165d-4fb0-85f2-cf3e154ea79e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d909274a59249c2b1277428e14fe96c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:43:07Z,use_quota=True,user_id='3d4245682d614bee9b35f68bbc465209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e53b7257-94e4-40cd-8329-ec248bcab4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e53b7257-94e4-40cd-8329-ec248bcab4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (789f1133-d28a-44a8-973e-144d2aa2ae16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:06 devstack cinder-volume[87726]: DEBUG cinder.image.glance [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Creating Keystone auth plugin from conf {{(pid=87726) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 19:43:06 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-445bb137-6b24-474b-a9de-f47be19149be tempest-VolumesTransfersV355Test-224329213 None] Created reservations ['d3db2725-6bb5-4ed6-a358-ece2d4096100', 'fa2dbde2-2708-473e-8c0f-eb9cc66c2ca6', '679669d1-0460-4e2d-a44a-51d5ea0ed495', '9d80e95b-ed56-42a5-9db1-754d79d2f292'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:43:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-445bb137-6b24-474b-a9de-f47be19149be tempest-VolumesTransfersV355Test-224329213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-445bb137-6b24-474b-a9de-f47be19149be tempest-VolumesTransfersV355Test-224329213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:06 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-445bb137-6b24-474b-a9de-f47be19149be tempest-VolumesTransfersV355Test-224329213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:43:06 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-445bb137-6b24-474b-a9de-f47be19149be tempest-VolumesTransfersV355Test-224329213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:43:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-445bb137-6b24-474b-a9de-f47be19149be tempest-VolumesTransfersV355Test-224329213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-445bb137-6b24-474b-a9de-f47be19149be tempest-VolumesTransfersV355Test-224329213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:07 devstack sudo[94795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:43:07 devstack sudo[94795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:07 devstack sudo[94795]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-445bb137-6b24-474b-a9de-f47be19149be tempest-VolumesTransfersV355Test-224329213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.291s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-445bb137-6b24-474b-a9de-f47be19149be tempest-VolumesTransfersV355Test-224329213 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:43:07 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-445bb137-6b24-474b-a9de-f47be19149be tempest-VolumesTransfersV355Test-224329213 None] Deleted volume successfully. Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-445bb137-6b24-474b-a9de-f47be19149be tempest-VolumesTransfersV355Test-224329213 None] Lock "cinder-ebcc0ba9-9a36-4fa5-9660-aefba848aa9a-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (789f1133-d28a-44a8-973e-144d2aa2ae16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8c45a321-165d-4fb0-85f2-cf3e154ea79e', 'volume_name': 'volume-8c45a321-165d-4fb0-85f2-cf3e154ea79e', 'volume_size': 1, 'image_id': '8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f9f36413d75c4b9e8be9b78b4ce9c162', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'created_at': datetime.datetime(2026, 7, 17, 17, 31, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 17, 31, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a438101-bca2-457f-a136-67c4015c1752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a438101-bca2-457f-a136-67c4015c1752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2794a5da-9a7e-4c56-b3c3-59f60df8fc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:07 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Volume 8c45a321-165d-4fb0-85f2-cf3e154ea79e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8c45a321-165d-4fb0-85f2-cf3e154ea79e', 'volume_size': 1, 'image_id': '8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f9f36413d75c4b9e8be9b78b4ce9c162', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'created_at': datetime.datetime(2026, 7, 17, 17, 31, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 17, 31, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Trying to clone 8c45a321-165d-4fb0-85f2-cf3e154ea79e from image 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'metadata': {}}]). {{(pid=87726) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] Flow 'volume_create_manager' (d9b3c36f-e385-475b-a6fb-9940c21561ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4624fad0-0dda-4d52-8bc6-43d390d0ee18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4624fad0-0dda-4d52-8bc6-43d390d0ee18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-942354659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a2267ce-44a4-45a5-be18-08d259423837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb4ab296a442419cb7a4f7f152b77b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:43:08Z,use_quota=True,user_id='3e2f4f4cf1094df89af8bb5320ae06b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f631359-c221-4fb0-9c0c-2eac8a0072a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f631359-c221-4fb0-9c0c-2eac8a0072a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229df0cc-0f26-438e-a76b-99c70a84bde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229df0cc-0f26-438e-a76b-99c70a84bde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a2267ce-44a4-45a5-be18-08d259423837', 'volume_name': 'volume-9a2267ce-44a4-45a5-be18-08d259423837', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a40178f0-2422-4a91-a205-2943754b9bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a40178f0-2422-4a91-a205-2943754b9bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45273a1e-c7cf-417a-a12a-14e9e4fdb976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:07 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] Volume 9a2267ce-44a4-45a5-be18-08d259423837: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a2267ce-44a4-45a5-be18-08d259423837', 'volume_size': 1} Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-942354659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a2267ce-44a4-45a5-be18-08d259423837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb4ab296a442419cb7a4f7f152b77b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:43:08Z,use_quota=True,user_id='3e2f4f4cf1094df89af8bb5320ae06b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] Creating volume 9a2267ce-44a4-45a5-be18-08d259423837 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:43:07 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9a2267ce-44a4-45a5-be18-08d259423837 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:07 devstack sudo[94819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9a2267ce-44a4-45a5-be18-08d259423837 1073741824 Jul 17 19:43:07 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_hmegx11ldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87726) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 19:43:07 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Image download 20.69 MB at 20.69 MB/s Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d042b9b-1b92-4862-9034-9c1135b7d58e]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:43:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_hmegx11ldevstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:08 devstack sudo[94821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_hmegx11ldevstack@QuobyteHD Jul 17 19:43:08 devstack sudo[94821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:08 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9a2267ce-44a4-45a5-be18-08d259423837 1073741824" returned: 0 in 0.477s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:08 devstack sudo[94821]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_hmegx11ldevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:08 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Temporary image 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 is fetched for user 3d4245682d614bee9b35f68bbc465209. {{(pid=87726) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 19:43:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9a2267ce-44a4-45a5-be18-08d259423837 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:08 devstack sudo[94830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9a2267ce-44a4-45a5-be18-08d259423837 Jul 17 19:43:08 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:08 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5dc4c5-ecc1-4275-b958-b95e40fe00db]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:43:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_hmegx11ldevstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:08 devstack sudo[94832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_hmegx11ldevstack@QuobyteHD Jul 17 19:43:08 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:08 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9a2267ce-44a4-45a5-be18-08d259423837" returned: 0 in 0.272s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:43:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45273a1e-c7cf-417a-a12a-14e9e4fdb976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a2267ce-44a4-45a5-be18-08d259423837', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70354fb-7b12-4f10-baa1-cb3b2e748dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:08 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] Volume volume-9a2267ce-44a4-45a5-be18-08d259423837 (9a2267ce-44a4-45a5-be18-08d259423837): created successfully Jul 17 19:43:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70354fb-7b12-4f10-baa1-cb3b2e748dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] Flow 'volume_create_manager' (d9b3c36f-e385-475b-a6fb-9940c21561ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:43:08 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-6508f2da-a8a4-4484-bb56-7944ba86a4f6 tempest-VolumesTransfersV355Test-1823254717 None] Created volume successfully. Jul 17 19:43:08 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_hmegx11ldevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-191010066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c45a321-165d-4fb0-85f2-cf3e154ea79e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d909274a59249c2b1277428e14fe96c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:43:07Z,use_quota=True,user_id='3d4245682d614bee9b35f68bbc465209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:43:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Creating volume 8c45a321-165d-4fb0-85f2-cf3e154ea79e {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:43:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:43:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:43:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:43:08 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:43:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8c45a321-165d-4fb0-85f2-cf3e154ea79e 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:08 devstack sudo[94838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8c45a321-165d-4fb0-85f2-cf3e154ea79e 1073741824 Jul 17 19:43:08 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:09 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8c45a321-165d-4fb0-85f2-cf3e154ea79e 1073741824" returned: 0 in 0.435s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8c45a321-165d-4fb0-85f2-cf3e154ea79e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:09 devstack sudo[94843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8c45a321-165d-4fb0-85f2-cf3e154ea79e Jul 17 19:43:09 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:09 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8c45a321-165d-4fb0-85f2-cf3e154ea79e" returned: 0 in 0.242s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:43:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:09 devstack cinder-volume[87726]: DEBUG cinder.volume.volume_utils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Attempting download of 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'metadata': {}}])) to volume 8c45a321-165d-4fb0-85f2-cf3e154ea79e. {{(pid=87726) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 19:43:09 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[751eb99c-0202-427e-9539-a1e496082bc9]: (4, 'raw') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:43:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_6gwwcpsf {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:09 devstack sudo[94847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_6gwwcpsf Jul 17 19:43:09 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:09 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_6gwwcpsf" returned: 0 in 0.392s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_6gwwcpsf {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e125de56-0084-45de-bd29-3a5e980c1135 tempest-VolumesTransfersV355Test-224329213 None] Acquiring lock "cinder-9a2267ce-44a4-45a5-be18-08d259423837-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:10 devstack sudo[94851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_6gwwcpsf Jul 17 19:43:10 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e125de56-0084-45de-bd29-3a5e980c1135 tempest-VolumesTransfersV355Test-224329213 None] Lock "cinder-9a2267ce-44a4-45a5-be18-08d259423837-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e125de56-0084-45de-bd29-3a5e980c1135 tempest-VolumesTransfersV355Test-224329213 None] Acquiring lock "cinder-quobyte-9a2267ce-44a4-45a5-be18-08d259423837" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e125de56-0084-45de-bd29-3a5e980c1135 tempest-VolumesTransfersV355Test-224329213 None] Lock "cinder-quobyte-9a2267ce-44a4-45a5-be18-08d259423837" acquired by "delete_volume" :: waited 0.024s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:10 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b99a85b-b59a-44ac-9516-184b975fbd2a]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:43:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e125de56-0084-45de-bd29-3a5e980c1135 tempest-VolumesTransfersV355Test-224329213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9a2267ce-44a4-45a5-be18-08d259423837 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:10 devstack sudo[94853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9a2267ce-44a4-45a5-be18-08d259423837 Jul 17 19:43:10 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:10 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_6gwwcpsf" returned: 1 in 0.396s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_6gwwcpsf' failed. Not Retrying. {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 19:43:10 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5d4284-de34-4d60-b6c5-fd890bfcdbad]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:43:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_hmegx11ldevstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:10 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_hmegx11ldevstack@QuobyteHD Jul 17 19:43:10 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:10 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e125de56-0084-45de-bd29-3a5e980c1135 tempest-VolumesTransfersV355Test-224329213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9a2267ce-44a4-45a5-be18-08d259423837" returned: 0 in 0.398s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e125de56-0084-45de-bd29-3a5e980c1135 tempest-VolumesTransfersV355Test-224329213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9a2267ce-44a4-45a5-be18-08d259423837 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:10 devstack sudo[94862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9a2267ce-44a4-45a5-be18-08d259423837 Jul 17 19:43:10 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:10 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_hmegx11ldevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:10 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 was qcow2, converting to qcow2 {{(pid=87726) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 19:43:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_hmegx11ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8c45a321-165d-4fb0-85f2-cf3e154ea79e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:10 devstack sudo[94867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_hmegx11ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8c45a321-165d-4fb0-85f2-cf3e154ea79e Jul 17 19:43:10 devstack sudo[94867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:10 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e125de56-0084-45de-bd29-3a5e980c1135 tempest-VolumesTransfersV355Test-224329213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-9a2267ce-44a4-45a5-be18-08d259423837" returned: 0 in 0.258s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e125de56-0084-45de-bd29-3a5e980c1135 tempest-VolumesTransfersV355Test-224329213 None] Lock "cinder-quobyte-9a2267ce-44a4-45a5-be18-08d259423837" released by "delete_volume" :: held 0.711s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:43:10 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-e125de56-0084-45de-bd29-3a5e980c1135 tempest-VolumesTransfersV355Test-224329213 None] Created reservations ['d7dddcc0-1a42-40a0-98e8-261671ab8921', '46415cc1-0ad9-4b0c-a2b8-726c02533969', 'f8bdaf6a-9988-48e3-af0e-cc4b415dd55e', 'db20c6e8-71fe-4f03-8ffb-5bff3148d3ff'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:43:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e125de56-0084-45de-bd29-3a5e980c1135 tempest-VolumesTransfersV355Test-224329213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e125de56-0084-45de-bd29-3a5e980c1135 tempest-VolumesTransfersV355Test-224329213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e125de56-0084-45de-bd29-3a5e980c1135 tempest-VolumesTransfersV355Test-224329213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:43:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e125de56-0084-45de-bd29-3a5e980c1135 tempest-VolumesTransfersV355Test-224329213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:43:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e125de56-0084-45de-bd29-3a5e980c1135 tempest-VolumesTransfersV355Test-224329213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e125de56-0084-45de-bd29-3a5e980c1135 tempest-VolumesTransfersV355Test-224329213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:11 devstack sudo[94873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:43:11 devstack sudo[94873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:11 devstack sudo[94873]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e125de56-0084-45de-bd29-3a5e980c1135 tempest-VolumesTransfersV355Test-224329213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.311s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:11 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-e125de56-0084-45de-bd29-3a5e980c1135 tempest-VolumesTransfersV355Test-224329213 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:43:11 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e125de56-0084-45de-bd29-3a5e980c1135 tempest-VolumesTransfersV355Test-224329213 None] Deleted volume successfully. Jul 17 19:43:11 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e125de56-0084-45de-bd29-3a5e980c1135 tempest-VolumesTransfersV355Test-224329213 None] Lock "cinder-9a2267ce-44a4-45a5-be18-08d259423837-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:43:12 devstack sudo[94867]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_hmegx11ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8c45a321-165d-4fb0-85f2-cf3e154ea79e" returned: 0 in 2.188s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:12 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_hmegx11ldevstack@QuobyteHD, size 112.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8c45a321-165d-4fb0-85f2-cf3e154ea79e {{(pid=87726) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 19:43:12 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Converted 112.00 MB image at 51.13 MB/s Jul 17 19:43:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8c45a321-165d-4fb0-85f2-cf3e154ea79e 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:12 devstack sudo[94908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8c45a321-165d-4fb0-85f2-cf3e154ea79e 1G Jul 17 19:43:12 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:13 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8c45a321-165d-4fb0-85f2-cf3e154ea79e 1G" returned: 0 in 0.552s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:13 devstack cinder-volume[87726]: DEBUG cinder.volume.volume_utils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Downloaded image 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'metadata': {}}])) to volume 8c45a321-165d-4fb0-85f2-cf3e154ea79e successfully. {{(pid=87726) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 19:43:13 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Temporary image 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 for user 3d4245682d614bee9b35f68bbc465209 is deleted. {{(pid=87726) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 19:43:13 devstack cinder-volume[87726]: DEBUG cinder.volume.volume_utils [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Marking volume 8c45a321-165d-4fb0-85f2-cf3e154ea79e as bootable. {{(pid=87726) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 19:43:13 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Copying metadata from image 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 to 8c45a321-165d-4fb0-85f2-cf3e154ea79e. {{(pid=87726) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 19:43:13 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Creating volume glance metadata for volume 8c45a321-165d-4fb0-85f2-cf3e154ea79e backed by image 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87726) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 19:43:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2794a5da-9a7e-4c56-b3c3-59f60df8fc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c45a321-165d-4fb0-85f2-cf3e154ea79e', 'volume_size': 1, 'image_id': '8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f9f36413d75c4b9e8be9b78b4ce9c162', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'created_at': datetime.datetime(2026, 7, 17, 17, 31, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 17, 31, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a644394-6a76-4345-9106-9435880ef053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:13 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Volume volume-8c45a321-165d-4fb0-85f2-cf3e154ea79e (8c45a321-165d-4fb0-85f2-cf3e154ea79e): created successfully Jul 17 19:43:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a644394-6a76-4345-9106-9435880ef053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Flow 'volume_create_manager' (ddb98510-255d-47b8-9e41-c89bb8f56608) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:43:13 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-b5273c18-21af-4f4b-b102-a6404d30ce6d tempest-VolumesExtendTest-754674633 None] Created volume successfully. Jul 17 19:43:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b9c49a79-d7b7-40a7-9c24-e8ca119cdaf5 tempest-VolumesExtendTest-754674633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b9c49a79-d7b7-40a7-9c24-e8ca119cdaf5 tempest-VolumesExtendTest-754674633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:14 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd26e717-4b3e-47a4-8ac6-2c0f8f1dfaba]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:43:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9c49a79-d7b7-40a7-9c24-e8ca119cdaf5 tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8c45a321-165d-4fb0-85f2-cf3e154ea79e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:14 devstack sudo[94925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8c45a321-165d-4fb0-85f2-cf3e154ea79e Jul 17 19:43:14 devstack sudo[94925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:14 devstack sudo[94925]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9c49a79-d7b7-40a7-9c24-e8ca119cdaf5 tempest-VolumesExtendTest-754674633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8c45a321-165d-4fb0-85f2-cf3e154ea79e" returned: 0 in 0.390s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9c49a79-d7b7-40a7-9c24-e8ca119cdaf5 tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8c45a321-165d-4fb0-85f2-cf3e154ea79e 2G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9c49a79-d7b7-40a7-9c24-e8ca119cdaf5 tempest-VolumesExtendTest-754674633 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8c45a321-165d-4fb0-85f2-cf3e154ea79e 2G" returned: 0 in 0.096s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b9c49a79-d7b7-40a7-9c24-e8ca119cdaf5 tempest-VolumesExtendTest-754674633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.512s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:15 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-b9c49a79-d7b7-40a7-9c24-e8ca119cdaf5 tempest-VolumesExtendTest-754674633 None] Extend volume completed successfully. Jul 17 19:43:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:43:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:43:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:43:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:15 devstack sudo[94942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:43:15 devstack sudo[94942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:15 devstack sudo[94942]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.258s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:15 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:43:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager._thread_info {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:43:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread count: 28 {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 19:43:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread info: [<_MainThread(MainThread, started 130066227544192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 19:43:15 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-b274e156-b7ff-464f-8622-5c0105d1b000 tempest-VolumesExtendTest-754674633 None] Acquiring lock "cinder-8c45a321-165d-4fb0-85f2-cf3e154ea79e-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:15 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-b274e156-b7ff-464f-8622-5c0105d1b000 tempest-VolumesExtendTest-754674633 None] Lock "cinder-8c45a321-165d-4fb0-85f2-cf3e154ea79e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:15 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-b274e156-b7ff-464f-8622-5c0105d1b000 tempest-VolumesExtendTest-754674633 None] Acquiring lock "cinder-quobyte-8c45a321-165d-4fb0-85f2-cf3e154ea79e" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:15 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-b274e156-b7ff-464f-8622-5c0105d1b000 tempest-VolumesExtendTest-754674633 None] Lock "cinder-quobyte-8c45a321-165d-4fb0-85f2-cf3e154ea79e" acquired by "delete_volume" :: waited 0.022s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:15 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[53eebade-9541-43a2-9946-707960c1d60d]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:43:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b274e156-b7ff-464f-8622-5c0105d1b000 tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8c45a321-165d-4fb0-85f2-cf3e154ea79e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:16 devstack sudo[94945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8c45a321-165d-4fb0-85f2-cf3e154ea79e Jul 17 19:43:16 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:16 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b274e156-b7ff-464f-8622-5c0105d1b000 tempest-VolumesExtendTest-754674633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8c45a321-165d-4fb0-85f2-cf3e154ea79e" returned: 0 in 0.360s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b274e156-b7ff-464f-8622-5c0105d1b000 tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8c45a321-165d-4fb0-85f2-cf3e154ea79e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:16 devstack sudo[94951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8c45a321-165d-4fb0-85f2-cf3e154ea79e Jul 17 19:43:16 devstack sudo[94951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:16 devstack sudo[94951]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b274e156-b7ff-464f-8622-5c0105d1b000 tempest-VolumesExtendTest-754674633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8c45a321-165d-4fb0-85f2-cf3e154ea79e" returned: 0 in 0.254s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-b274e156-b7ff-464f-8622-5c0105d1b000 tempest-VolumesExtendTest-754674633 None] Lock "cinder-quobyte-8c45a321-165d-4fb0-85f2-cf3e154ea79e" released by "delete_volume" :: held 0.668s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:43:16 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-b274e156-b7ff-464f-8622-5c0105d1b000 tempest-VolumesExtendTest-754674633 None] Created reservations ['4e7c7ddb-a7db-4076-9bfd-045f534cfd9e', '83286964-9137-437d-a335-681db3bc975f', '128edac7-960e-4c63-88fa-b4619a5438eb', '97b28f17-604e-4826-a3b3-e1acb39e9450'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:43:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b274e156-b7ff-464f-8622-5c0105d1b000 tempest-VolumesExtendTest-754674633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b274e156-b7ff-464f-8622-5c0105d1b000 tempest-VolumesExtendTest-754674633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:16 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b274e156-b7ff-464f-8622-5c0105d1b000 tempest-VolumesExtendTest-754674633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:43:16 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b274e156-b7ff-464f-8622-5c0105d1b000 tempest-VolumesExtendTest-754674633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:43:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b274e156-b7ff-464f-8622-5c0105d1b000 tempest-VolumesExtendTest-754674633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b274e156-b7ff-464f-8622-5c0105d1b000 tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:16 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:43:16 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:16 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b274e156-b7ff-464f-8622-5c0105d1b000 tempest-VolumesExtendTest-754674633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.248s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-b274e156-b7ff-464f-8622-5c0105d1b000 tempest-VolumesExtendTest-754674633 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:43:17 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-b274e156-b7ff-464f-8622-5c0105d1b000 tempest-VolumesExtendTest-754674633 None] Deleted volume successfully. Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-b274e156-b7ff-464f-8622-5c0105d1b000 tempest-VolumesExtendTest-754674633 None] Lock "cinder-8c45a321-165d-4fb0-85f2-cf3e154ea79e-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] Flow 'volume_create_manager' (86cbbe8c-c463-4225-8437-fe6cb01d4c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e80282-0ac8-49d5-bd9c-c76f41da7091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e80282-0ac8-49d5-bd9c-c76f41da7091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1883486709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fb71f3b-e606-4d4b-92d5-a3c323b39c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d909274a59249c2b1277428e14fe96c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:43:17Z,use_quota=True,user_id='3d4245682d614bee9b35f68bbc465209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b01d0d73-75a8-4892-944b-9df59d57de1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b01d0d73-75a8-4892-944b-9df59d57de1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (322f9dc4-61a4-44aa-892c-fe8f4d573bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (322f9dc4-61a4-44aa-892c-fe8f4d573bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fb71f3b-e606-4d4b-92d5-a3c323b39c57', 'volume_name': 'volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2def81b-a7c4-4bd0-ac74-73f66a9231cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2def81b-a7c4-4bd0-ac74-73f66a9231cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45a8d3dc-fc29-49b7-b49b-6d3c3664c585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:17 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] Volume 2fb71f3b-e606-4d4b-92d5-a3c323b39c57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57', 'volume_size': 1} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1883486709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fb71f3b-e606-4d4b-92d5-a3c323b39c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d909274a59249c2b1277428e14fe96c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:43:17Z,use_quota=True,user_id='3d4245682d614bee9b35f68bbc465209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] Creating volume 2fb71f3b-e606-4d4b-92d5-a3c323b39c57 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:43:17 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:17 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57 1073741824 Jul 17 19:43:17 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] Flow 'volume_create_manager' (03f5a6cb-053b-4723-bc1d-57fae7ab851f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f6bae17-9fcc-4bcc-b76e-1b3152831c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f6bae17-9fcc-4bcc-b76e-1b3152831c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1468011517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f14915-e5cf-4f6c-a777-0c8d786c98b2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='952812c7672047ec8b56b836145507ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:43:18Z,use_quota=True,user_id='f1e28d03a4524051a0f2bdf474adbaf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff302e4c-cfc0-474e-837d-03d2bf3d3547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff302e4c-cfc0-474e-837d-03d2bf3d3547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f608a2db-8442-43b3-a2fe-50e51ab2ae77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f608a2db-8442-43b3-a2fe-50e51ab2ae77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84f14915-e5cf-4f6c-a777-0c8d786c98b2', 'volume_name': 'volume-84f14915-e5cf-4f6c-a777-0c8d786c98b2', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cff9869-e5cb-425a-9f42-14d160f82a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cff9869-e5cb-425a-9f42-14d160f82a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f4c4f48-0769-4faf-a8d1-5c563d10ad0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:17 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] Volume 84f14915-e5cf-4f6c-a777-0c8d786c98b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84f14915-e5cf-4f6c-a777-0c8d786c98b2', 'volume_size': 1} Jul 17 19:43:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:18 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57 1073741824" returned: 0 in 0.398s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:18 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57 Jul 17 19:43:18 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:18 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57" returned: 0 in 0.248s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:18 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:43:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.524s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:18 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1468011517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f14915-e5cf-4f6c-a777-0c8d786c98b2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='952812c7672047ec8b56b836145507ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:43:18Z,use_quota=True,user_id='f1e28d03a4524051a0f2bdf474adbaf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:43:18 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] Creating volume 84f14915-e5cf-4f6c-a777-0c8d786c98b2 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:43:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:18 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:43:18 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:43:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:18 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:43:18 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:43:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84f14915-e5cf-4f6c-a777-0c8d786c98b2 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45a8d3dc-fc29-49b7-b49b-6d3c3664c585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:18 devstack sudo[94966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84f14915-e5cf-4f6c-a777-0c8d786c98b2 1073741824 Jul 17 19:43:18 devstack sudo[94966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad9a30ca-1174-420f-91c6-edd040e02c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:18 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] Volume volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57 (2fb71f3b-e606-4d4b-92d5-a3c323b39c57): created successfully Jul 17 19:43:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad9a30ca-1174-420f-91c6-edd040e02c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] Flow 'volume_create_manager' (86cbbe8c-c463-4225-8437-fe6cb01d4c99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:43:18 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-ec1b35bf-4f9d-4d4c-a422-a295217743bb tempest-VolumesExtendTest-754674633 None] Created volume successfully. Jul 17 19:43:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0063da5d-6ab5-4056-aa82-6214948976f6 tempest-VolumesExtendTest-754674633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:18 devstack sudo[94966]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84f14915-e5cf-4f6c-a777-0c8d786c98b2 1073741824" returned: 0 in 0.501s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84f14915-e5cf-4f6c-a777-0c8d786c98b2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:18 devstack sudo[94971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84f14915-e5cf-4f6c-a777-0c8d786c98b2 Jul 17 19:43:18 devstack sudo[94971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:19 devstack sudo[94971]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84f14915-e5cf-4f6c-a777-0c8d786c98b2" returned: 0 in 0.251s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:19 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:43:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0063da5d-6ab5-4056-aa82-6214948976f6 tempest-VolumesExtendTest-754674633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.389s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f4c4f48-0769-4faf-a8d1-5c563d10ad0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84f14915-e5cf-4f6c-a777-0c8d786c98b2', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a469e4-feaa-4797-af6c-1fdf7efebf4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:19 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-0063da5d-6ab5-4056-aa82-6214948976f6 tempest-VolumesExtendTest-754674633 None] Creating offline snapshot 03e7560c-3baa-4987-aa00-152006ee86e6 of volume 2fb71f3b-e606-4d4b-92d5-a3c323b39c57 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:43:19 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] Volume volume-84f14915-e5cf-4f6c-a777-0c8d786c98b2 (84f14915-e5cf-4f6c-a777-0c8d786c98b2): created successfully Jul 17 19:43:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a469e4-feaa-4797-af6c-1fdf7efebf4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] Flow 'volume_create_manager' (03f5a6cb-053b-4723-bc1d-57fae7ab851f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:43:19 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee00793-c65b-441b-bbd1-384de83fff88]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:43:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0063da5d-6ab5-4056-aa82-6214948976f6 tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:19 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e09c3877-f18c-4632-8d67-d9e52afa30f4 tempest-VolumesGetTest-1683131619 None] Created volume successfully. Jul 17 19:43:19 devstack sudo[94975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57 Jul 17 19:43:19 devstack sudo[94975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:19 devstack sudo[94975]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0063da5d-6ab5-4056-aa82-6214948976f6 tempest-VolumesExtendTest-754674633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57" returned: 0 in 0.407s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0063da5d-6ab5-4056-aa82-6214948976f6 tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57.03e7560c-3baa-4987-aa00-152006ee86e6 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:19 devstack sudo[94982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57.03e7560c-3baa-4987-aa00-152006ee86e6 1G Jul 17 19:43:19 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:20 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0063da5d-6ab5-4056-aa82-6214948976f6 tempest-VolumesExtendTest-754674633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57.03e7560c-3baa-4987-aa00-152006ee86e6 1G" returned: 0 in 0.730s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0063da5d-6ab5-4056-aa82-6214948976f6 tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57.03e7560c-3baa-4987-aa00-152006ee86e6 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:20 devstack sudo[95005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57.03e7560c-3baa-4987-aa00-152006ee86e6 Jul 17 19:43:20 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:20 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0063da5d-6ab5-4056-aa82-6214948976f6 tempest-VolumesExtendTest-754674633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57.03e7560c-3baa-4987-aa00-152006ee86e6" returned: 0 in 0.470s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:20 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-0063da5d-6ab5-4056-aa82-6214948976f6 tempest-VolumesExtendTest-754674633 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57.03e7560c-3baa-4987-aa00-152006ee86e6 is being set with open permissions: ugo+rw Jul 17 19:43:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0063da5d-6ab5-4056-aa82-6214948976f6 tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57.03e7560c-3baa-4987-aa00-152006ee86e6 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:20 devstack sudo[95020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57.03e7560c-3baa-4987-aa00-152006ee86e6 Jul 17 19:43:20 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:20 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:43:20 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] Flow 'volume_create_manager' (d696e820-963f-4683-ba3c-b2d697d5adc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:43:20 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd023d64-b1d5-4930-ac32-652651cc0600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:20 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd023d64-b1d5-4930-ac32-652651cc0600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:43:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1213718658',display_name='tempest-VolumesGetTest-Volume-683294425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f23033c-345a-413b-8a39-33ec068c148d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952812c7672047ec8b56b836145507ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:43:21Z,use_quota=True,user_id='f1e28d03a4524051a0f2bdf474adbaf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7ac67f-d8b2-486a-897b-859bfc1c3ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7ac67f-d8b2-486a-897b-859bfc1c3ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1005b9f9-cdcb-46f2-85ea-204dd6407c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1005b9f9-cdcb-46f2-85ea-204dd6407c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f23033c-345a-413b-8a39-33ec068c148d', 'volume_name': 'volume-6f23033c-345a-413b-8a39-33ec068c148d', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e7258e-ca50-4a90-9fcb-98693c1c02c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e7258e-ca50-4a90-9fcb-98693c1c02c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e100b28c-f3a8-44d7-9548-ea59c799d6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:21 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] Volume 6f23033c-345a-413b-8a39-33ec068c148d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f23033c-345a-413b-8a39-33ec068c148d', 'volume_size': 1} Jul 17 19:43:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:21 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0063da5d-6ab5-4056-aa82-6214948976f6 tempest-VolumesExtendTest-754674633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57.03e7560c-3baa-4987-aa00-152006ee86e6" returned: 0 in 0.321s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0063da5d-6ab5-4056-aa82-6214948976f6 tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:21 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57.info Jul 17 19:43:21 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:21 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0063da5d-6ab5-4056-aa82-6214948976f6 tempest-VolumesExtendTest-754674633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57.info" returned: 0 in 0.353s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:21 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-0063da5d-6ab5-4056-aa82-6214948976f6 tempest-VolumesExtendTest-754674633 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57.info is being set with open permissions: ugo+rw Jul 17 19:43:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0063da5d-6ab5-4056-aa82-6214948976f6 tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:21 devstack sudo[95028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57.info Jul 17 19:43:21 devstack sudo[95028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:21 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-5f427643-c496-43c3-af46-33df0575817c req-3374fd66-a553-49ca-89e5-cb6eceadf70a tempest-AttachVolumeTestJSON-1460626915 None] Terminate volume connection completed successfully. Jul 17 19:43:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-5f427643-c496-43c3-af46-33df0575817c req-3374fd66-a553-49ca-89e5-cb6eceadf70a tempest-AttachVolumeTestJSON-1460626915 None] Deleting attachment 6a92f6cf-8df5-4f3c-8f8e-a742f4f34a49. {{(pid=87726) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 19:43:21 devstack sudo[95028]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0063da5d-6ab5-4056-aa82-6214948976f6 tempest-VolumesExtendTest-754674633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57.info" returned: 0 in 0.288s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0063da5d-6ab5-4056-aa82-6214948976f6 tempest-VolumesExtendTest-754674633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.722s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.810s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:43:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1213718658',display_name='tempest-VolumesGetTest-Volume-683294425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f23033c-345a-413b-8a39-33ec068c148d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952812c7672047ec8b56b836145507ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:43:21Z,use_quota=True,user_id='f1e28d03a4524051a0f2bdf474adbaf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:43:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] Creating volume 6f23033c-345a-413b-8a39-33ec068c148d {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:43:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:43:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:43:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:43:21 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:43:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6f23033c-345a-413b-8a39-33ec068c148d 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:21 devstack sudo[95034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6f23033c-345a-413b-8a39-33ec068c148d 1073741824 Jul 17 19:43:21 devstack sudo[95034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:21 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-0063da5d-6ab5-4056-aa82-6214948976f6 tempest-VolumesExtendTest-754674633 None] Create snapshot completed successfully Jul 17 19:43:22 devstack sudo[95034]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6f23033c-345a-413b-8a39-33ec068c148d 1073741824" returned: 0 in 0.504s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6f23033c-345a-413b-8a39-33ec068c148d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:22 devstack sudo[95041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6f23033c-345a-413b-8a39-33ec068c148d Jul 17 19:43:22 devstack sudo[95041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:22 devstack sudo[95041]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6f23033c-345a-413b-8a39-33ec068c148d" returned: 0 in 0.327s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:43:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e100b28c-f3a8-44d7-9548-ea59c799d6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f23033c-345a-413b-8a39-33ec068c148d', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38a88359-9ab9-4969-9192-eec50a625ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:22 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] Volume volume-6f23033c-345a-413b-8a39-33ec068c148d (6f23033c-345a-413b-8a39-33ec068c148d): created successfully Jul 17 19:43:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38a88359-9ab9-4969-9192-eec50a625ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] Flow 'volume_create_manager' (d696e820-963f-4683-ba3c-b2d697d5adc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:43:22 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-d782da5e-bdfc-477c-b413-01c8e527d709 tempest-VolumesGetTest-1683131619 None] Created volume successfully. Jul 17 19:43:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-99e18ff9-2e04-48f4-9879-f0d08e2d2804 tempest-VolumesExtendTest-754674633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-99e18ff9-2e04-48f4-9879-f0d08e2d2804 tempest-VolumesExtendTest-754674633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:23 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fb1828-b44b-46ba-ae1b-8055f102b2c0]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:43:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e18ff9-2e04-48f4-9879-f0d08e2d2804 tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a83c56f7-ed9c-41a6-995b-71c2cdf8ad0b tempest-VolumesGetTest-1683131619 None] Acquiring lock "cinder-6f23033c-345a-413b-8a39-33ec068c148d-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a83c56f7-ed9c-41a6-995b-71c2cdf8ad0b tempest-VolumesGetTest-1683131619 None] Lock "cinder-6f23033c-345a-413b-8a39-33ec068c148d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a83c56f7-ed9c-41a6-995b-71c2cdf8ad0b tempest-VolumesGetTest-1683131619 None] Acquiring lock "cinder-quobyte-6f23033c-345a-413b-8a39-33ec068c148d" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:23 devstack sudo[95049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57 Jul 17 19:43:23 devstack sudo[95049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a83c56f7-ed9c-41a6-995b-71c2cdf8ad0b tempest-VolumesGetTest-1683131619 None] Lock "cinder-quobyte-6f23033c-345a-413b-8a39-33ec068c148d" acquired by "delete_volume" :: waited 0.024s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:23 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb23945-f78e-402c-a3b2-c37346fbeb3a]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:43:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a83c56f7-ed9c-41a6-995b-71c2cdf8ad0b tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6f23033c-345a-413b-8a39-33ec068c148d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:23 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6f23033c-345a-413b-8a39-33ec068c148d Jul 17 19:43:23 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:23 devstack sudo[95049]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e18ff9-2e04-48f4-9879-f0d08e2d2804 tempest-VolumesExtendTest-754674633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57" returned: 0 in 0.424s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e18ff9-2e04-48f4-9879-f0d08e2d2804 tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57.03e7560c-3baa-4987-aa00-152006ee86e6 2G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:23 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a83c56f7-ed9c-41a6-995b-71c2cdf8ad0b tempest-VolumesGetTest-1683131619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6f23033c-345a-413b-8a39-33ec068c148d" returned: 0 in 0.383s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a83c56f7-ed9c-41a6-995b-71c2cdf8ad0b tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6f23033c-345a-413b-8a39-33ec068c148d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99e18ff9-2e04-48f4-9879-f0d08e2d2804 tempest-VolumesExtendTest-754674633 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57.03e7560c-3baa-4987-aa00-152006ee86e6 2G" returned: 0 in 0.144s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-99e18ff9-2e04-48f4-9879-f0d08e2d2804 tempest-VolumesExtendTest-754674633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.615s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:23 devstack sudo[95064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6f23033c-345a-413b-8a39-33ec068c148d Jul 17 19:43:23 devstack sudo[95064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:23 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-99e18ff9-2e04-48f4-9879-f0d08e2d2804 tempest-VolumesExtendTest-754674633 None] Extend volume completed successfully. Jul 17 19:43:23 devstack sudo[95064]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a83c56f7-ed9c-41a6-995b-71c2cdf8ad0b tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6f23033c-345a-413b-8a39-33ec068c148d" returned: 0 in 0.290s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:24 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a83c56f7-ed9c-41a6-995b-71c2cdf8ad0b tempest-VolumesGetTest-1683131619 None] Lock "cinder-quobyte-6f23033c-345a-413b-8a39-33ec068c148d" released by "delete_volume" :: held 0.735s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:43:24 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-a83c56f7-ed9c-41a6-995b-71c2cdf8ad0b tempest-VolumesGetTest-1683131619 None] Created reservations ['6dda46b4-4446-4f48-b785-e7aaa1fcc756', 'f3d7777f-cc7a-44ab-8ea6-e21e520e6d6b', 'e67a497c-9ceb-40a4-b282-2292dfc80475', '644b9d0e-8b1f-4588-8672-7e1986e67e7e'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:43:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a83c56f7-ed9c-41a6-995b-71c2cdf8ad0b tempest-VolumesGetTest-1683131619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a83c56f7-ed9c-41a6-995b-71c2cdf8ad0b tempest-VolumesGetTest-1683131619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a83c56f7-ed9c-41a6-995b-71c2cdf8ad0b tempest-VolumesGetTest-1683131619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:43:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a83c56f7-ed9c-41a6-995b-71c2cdf8ad0b tempest-VolumesGetTest-1683131619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:43:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a83c56f7-ed9c-41a6-995b-71c2cdf8ad0b tempest-VolumesGetTest-1683131619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a83c56f7-ed9c-41a6-995b-71c2cdf8ad0b tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:24 devstack sudo[95068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:43:24 devstack sudo[95068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:24 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6b23216f-b8cc-4267-8324-478b061c723c tempest-VolumesExtendTest-754674633 None] Acquiring lock "cinder-03e7560c-3baa-4987-aa00-152006ee86e6-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:24 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6b23216f-b8cc-4267-8324-478b061c723c tempest-VolumesExtendTest-754674633 None] Lock "cinder-03e7560c-3baa-4987-aa00-152006ee86e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:24 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6b23216f-b8cc-4267-8324-478b061c723c tempest-VolumesExtendTest-754674633 None] Acquiring lock "cinder-quobyte-2fb71f3b-e606-4d4b-92d5-a3c323b39c57" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:24 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0285a91e-4c33-4820-acef-35b85b8e8c85 tempest-VolumesGetTest-1683131619 None] Acquiring lock "cinder-84f14915-e5cf-4f6c-a777-0c8d786c98b2-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:24 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6b23216f-b8cc-4267-8324-478b061c723c tempest-VolumesExtendTest-754674633 None] Lock "cinder-quobyte-2fb71f3b-e606-4d4b-92d5-a3c323b39c57" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:24 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6b23216f-b8cc-4267-8324-478b061c723c tempest-VolumesExtendTest-754674633 None] Acquiring lock "cinder-quobyte-03e7560c-3baa-4987-aa00-152006ee86e6" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:24 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6b23216f-b8cc-4267-8324-478b061c723c tempest-VolumesExtendTest-754674633 None] Lock "cinder-quobyte-03e7560c-3baa-4987-aa00-152006ee86e6" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-6b23216f-b8cc-4267-8324-478b061c723c tempest-VolumesExtendTest-754674633 None] Deleting offline snapshot 03e7560c-3baa-4987-aa00-152006ee86e6 of volume 2fb71f3b-e606-4d4b-92d5-a3c323b39c57 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:43:24 devstack sudo[95068]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-6b23216f-b8cc-4267-8324-478b061c723c tempest-VolumesExtendTest-754674633 None] snapshot_file for this snap is: volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57.03e7560c-3baa-4987-aa00-152006ee86e6 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:43:24 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0285a91e-4c33-4820-acef-35b85b8e8c85 tempest-VolumesGetTest-1683131619 None] Lock "cinder-84f14915-e5cf-4f6c-a777-0c8d786c98b2-delete_volume" acquired by "delete_volume" :: waited 0.122s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a83c56f7-ed9c-41a6-995b-71c2cdf8ad0b tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.499s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:24 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[585dad01-1ac0-47fd-9576-6ba2427c36c7]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:43:24 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-a83c56f7-ed9c-41a6-995b-71c2cdf8ad0b tempest-VolumesGetTest-1683131619 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:43:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6b23216f-b8cc-4267-8324-478b061c723c tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57.03e7560c-3baa-4987-aa00-152006ee86e6 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:24 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-a83c56f7-ed9c-41a6-995b-71c2cdf8ad0b tempest-VolumesGetTest-1683131619 None] Deleted volume successfully. Jul 17 19:43:24 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-b6833444-97d7-455a-99af-767787d8896c req-6244f54d-fc9d-4445-bb09-4a5c8bece546 tempest-AttachVolumeNegativeTest-1875054094 None] Terminate volume connection completed successfully. Jul 17 19:43:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-b6833444-97d7-455a-99af-767787d8896c req-6244f54d-fc9d-4445-bb09-4a5c8bece546 tempest-AttachVolumeNegativeTest-1875054094 None] Deleting attachment 96830167-f906-4a15-976e-ef39eb5410f5. {{(pid=87726) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 19:43:24 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a83c56f7-ed9c-41a6-995b-71c2cdf8ad0b tempest-VolumesGetTest-1683131619 None] Lock "cinder-6f23033c-345a-413b-8a39-33ec068c148d-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:43:24 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0285a91e-4c33-4820-acef-35b85b8e8c85 tempest-VolumesGetTest-1683131619 None] Acquiring lock "cinder-quobyte-84f14915-e5cf-4f6c-a777-0c8d786c98b2" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:24 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0285a91e-4c33-4820-acef-35b85b8e8c85 tempest-VolumesGetTest-1683131619 None] Lock "cinder-quobyte-84f14915-e5cf-4f6c-a777-0c8d786c98b2" acquired by "delete_volume" :: waited 0.026s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:24 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ceaebd-b2a2-443a-b457-f87a36f6d737]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:43:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0285a91e-4c33-4820-acef-35b85b8e8c85 tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84f14915-e5cf-4f6c-a777-0c8d786c98b2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:24 devstack sudo[95074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57.03e7560c-3baa-4987-aa00-152006ee86e6 Jul 17 19:43:24 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:24 devstack sudo[95075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84f14915-e5cf-4f6c-a777-0c8d786c98b2 Jul 17 19:43:24 devstack sudo[95075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:25 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6b23216f-b8cc-4267-8324-478b061c723c tempest-VolumesExtendTest-754674633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57.03e7560c-3baa-4987-aa00-152006ee86e6" returned: 0 in 0.490s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-6b23216f-b8cc-4267-8324-478b061c723c tempest-VolumesExtendTest-754674633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:43:25 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[32209de6-5afa-443f-ba3f-68e84e1a0480]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:43:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6b23216f-b8cc-4267-8324-478b061c723c tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:25 devstack sudo[95075]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0285a91e-4c33-4820-acef-35b85b8e8c85 tempest-VolumesGetTest-1683131619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84f14915-e5cf-4f6c-a777-0c8d786c98b2" returned: 0 in 0.458s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0285a91e-4c33-4820-acef-35b85b8e8c85 tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84f14915-e5cf-4f6c-a777-0c8d786c98b2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:25 devstack sudo[95091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84f14915-e5cf-4f6c-a777-0c8d786c98b2 Jul 17 19:43:25 devstack sudo[95091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:25 devstack sudo[95089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57 Jul 17 19:43:25 devstack sudo[95089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:25 devstack sudo[95091]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0285a91e-4c33-4820-acef-35b85b8e8c85 tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84f14915-e5cf-4f6c-a777-0c8d786c98b2" returned: 0 in 0.656s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:25 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0285a91e-4c33-4820-acef-35b85b8e8c85 tempest-VolumesGetTest-1683131619 None] Lock "cinder-quobyte-84f14915-e5cf-4f6c-a777-0c8d786c98b2" released by "delete_volume" :: held 1.197s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:43:26 devstack sudo[95089]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6b23216f-b8cc-4267-8324-478b061c723c tempest-VolumesExtendTest-754674633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57" returned: 0 in 0.803s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6b23216f-b8cc-4267-8324-478b061c723c tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57.03e7560c-3baa-4987-aa00-152006ee86e6 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:26 devstack sudo[95117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57.03e7560c-3baa-4987-aa00-152006ee86e6 Jul 17 19:43:26 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:26 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-0285a91e-4c33-4820-acef-35b85b8e8c85 tempest-VolumesGetTest-1683131619 None] Created reservations ['1aa35d17-743d-46ed-a50b-7cc14d5805b6', '66b47269-d46a-44a9-a2cd-036fd4d55527', '9ec17691-4388-4c05-b5db-51ede762f41f', '8bcf4ad2-fd53-4bbc-944d-804c01e0e7a2'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:43:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0285a91e-4c33-4820-acef-35b85b8e8c85 tempest-VolumesGetTest-1683131619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0285a91e-4c33-4820-acef-35b85b8e8c85 tempest-VolumesGetTest-1683131619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:26 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0285a91e-4c33-4820-acef-35b85b8e8c85 tempest-VolumesGetTest-1683131619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:43:26 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0285a91e-4c33-4820-acef-35b85b8e8c85 tempest-VolumesGetTest-1683131619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:43:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0285a91e-4c33-4820-acef-35b85b8e8c85 tempest-VolumesGetTest-1683131619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0285a91e-4c33-4820-acef-35b85b8e8c85 tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:26 devstack sudo[95132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:43:26 devstack sudo[95132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:26 devstack sudo[95132]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0285a91e-4c33-4820-acef-35b85b8e8c85 tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.357s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:26 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-0285a91e-4c33-4820-acef-35b85b8e8c85 tempest-VolumesGetTest-1683131619 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:43:26 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-0285a91e-4c33-4820-acef-35b85b8e8c85 tempest-VolumesGetTest-1683131619 None] Deleted volume successfully. Jul 17 19:43:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0285a91e-4c33-4820-acef-35b85b8e8c85 tempest-VolumesGetTest-1683131619 None] Lock "cinder-84f14915-e5cf-4f6c-a777-0c8d786c98b2-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:43:26 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6b23216f-b8cc-4267-8324-478b061c723c tempest-VolumesExtendTest-754674633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57.03e7560c-3baa-4987-aa00-152006ee86e6" returned: 0 in 0.693s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6b23216f-b8cc-4267-8324-478b061c723c tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57.03e7560c-3baa-4987-aa00-152006ee86e6 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:26 devstack sudo[95150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57.03e7560c-3baa-4987-aa00-152006ee86e6 Jul 17 19:43:26 devstack sudo[95150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:27 devstack sudo[95150]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6b23216f-b8cc-4267-8324-478b061c723c tempest-VolumesExtendTest-754674633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57.03e7560c-3baa-4987-aa00-152006ee86e6" returned: 0 in 0.503s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6b23216f-b8cc-4267-8324-478b061c723c tempest-VolumesExtendTest-754674633 None] Lock "cinder-quobyte-03e7560c-3baa-4987-aa00-152006ee86e6" released by "_delete_snapshot" :: held 2.700s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:43:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6b23216f-b8cc-4267-8324-478b061c723c tempest-VolumesExtendTest-754674633 None] Lock "cinder-quobyte-2fb71f3b-e606-4d4b-92d5-a3c323b39c57" released by "delete_snapshot" :: held 2.776s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:43:27 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-6b23216f-b8cc-4267-8324-478b061c723c tempest-VolumesExtendTest-754674633 None] Created reservations ['19bc3ed3-eeb4-4dd6-8b6a-72beb8b99514', '3ead61db-0841-4db2-8fcb-9d57acb3f145', '001539ec-d11c-44ec-9b83-99ab877b2daf', '822d60a1-f29a-4f84-8d5d-da86583c3df7'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:43:27 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-6b23216f-b8cc-4267-8324-478b061c723c tempest-VolumesExtendTest-754674633 None] Delete snapshot completed successfully. Jul 17 19:43:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6b23216f-b8cc-4267-8324-478b061c723c tempest-VolumesExtendTest-754674633 None] Lock "cinder-03e7560c-3baa-4987-aa00-152006ee86e6-delete_snapshot" released by "delete_snapshot" :: held 3.117s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:43:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9a810071-c60c-417c-b575-35c6dacc4861 tempest-VolumesExtendTest-754674633 None] Acquiring lock "cinder-2fb71f3b-e606-4d4b-92d5-a3c323b39c57-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9a810071-c60c-417c-b575-35c6dacc4861 tempest-VolumesExtendTest-754674633 None] Lock "cinder-2fb71f3b-e606-4d4b-92d5-a3c323b39c57-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:28 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:43:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] Flow 'volume_create_manager' (79b3800d-bfc2-4e3b-b4c3-a1ffb8c076c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:43:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f221809-df8c-4d8f-b2c2-9745c58d5b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f221809-df8c-4d8f-b2c2-9745c58d5b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1642388739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f47447a-3c68-4cd3-8f57-4303ae483fee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952812c7672047ec8b56b836145507ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:43:28Z,use_quota=True,user_id='f1e28d03a4524051a0f2bdf474adbaf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d5c4a5-26d0-4a63-85e4-1c6f6c1d2b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d5c4a5-26d0-4a63-85e4-1c6f6c1d2b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00850c7a-ae79-48de-9c6d-7c9e3782349a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00850c7a-ae79-48de-9c6d-7c9e3782349a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f47447a-3c68-4cd3-8f57-4303ae483fee', 'volume_name': 'volume-1f47447a-3c68-4cd3-8f57-4303ae483fee', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84418f11-90a1-4c4e-a5fb-dea9e7914273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84418f11-90a1-4c4e-a5fb-dea9e7914273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c81a36-674a-4138-a27e-dba4220cab65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:28 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] Volume 1f47447a-3c68-4cd3-8f57-4303ae483fee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f47447a-3c68-4cd3-8f57-4303ae483fee', 'volume_size': 1} Jul 17 19:43:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1642388739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f47447a-3c68-4cd3-8f57-4303ae483fee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952812c7672047ec8b56b836145507ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:43:28Z,use_quota=True,user_id='f1e28d03a4524051a0f2bdf474adbaf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:43:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] Creating volume 1f47447a-3c68-4cd3-8f57-4303ae483fee {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:43:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:43:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:43:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:43:28 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:43:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9a810071-c60c-417c-b575-35c6dacc4861 tempest-VolumesExtendTest-754674633 None] Acquiring lock "cinder-quobyte-2fb71f3b-e606-4d4b-92d5-a3c323b39c57" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:28 devstack sudo[95217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee 1073741824 Jul 17 19:43:28 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9a810071-c60c-417c-b575-35c6dacc4861 tempest-VolumesExtendTest-754674633 None] Lock "cinder-quobyte-2fb71f3b-e606-4d4b-92d5-a3c323b39c57" acquired by "delete_volume" :: waited 0.035s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:28 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c068b4-8317-4ef0-80f6-f128d7e40b04]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:43:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9a810071-c60c-417c-b575-35c6dacc4861 tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:28 devstack sudo[95220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57 Jul 17 19:43:28 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:29 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9a810071-c60c-417c-b575-35c6dacc4861 tempest-VolumesExtendTest-754674633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57" returned: 0 in 0.614s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9a810071-c60c-417c-b575-35c6dacc4861 tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:29 devstack sudo[95231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57 Jul 17 19:43:29 devstack sudo[95231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:29 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee 1073741824" returned: 0 in 1.236s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:29 devstack sudo[95231]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9a810071-c60c-417c-b575-35c6dacc4861 tempest-VolumesExtendTest-754674633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fb71f3b-e606-4d4b-92d5-a3c323b39c57" returned: 0 in 0.568s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:29 devstack sudo[95239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee Jul 17 19:43:29 devstack sudo[95239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9a810071-c60c-417c-b575-35c6dacc4861 tempest-VolumesExtendTest-754674633 None] Lock "cinder-quobyte-2fb71f3b-e606-4d4b-92d5-a3c323b39c57" released by "delete_volume" :: held 1.303s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:43:29 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-9a810071-c60c-417c-b575-35c6dacc4861 tempest-VolumesExtendTest-754674633 None] Created reservations ['908f2831-a829-46a3-9c0a-021192f7b38b', '5e605649-927a-4ce9-b94d-7b2ecc8ff212', '3616bce9-776e-4cf7-90ae-6974f1f982c7', 'ba066a8c-835a-4959-9231-3738ada42523'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:43:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9a810071-c60c-417c-b575-35c6dacc4861 tempest-VolumesExtendTest-754674633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9a810071-c60c-417c-b575-35c6dacc4861 tempest-VolumesExtendTest-754674633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:29 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9a810071-c60c-417c-b575-35c6dacc4861 tempest-VolumesExtendTest-754674633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:43:29 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9a810071-c60c-417c-b575-35c6dacc4861 tempest-VolumesExtendTest-754674633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:43:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9a810071-c60c-417c-b575-35c6dacc4861 tempest-VolumesExtendTest-754674633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9a810071-c60c-417c-b575-35c6dacc4861 tempest-VolumesExtendTest-754674633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:29 devstack sudo[95241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:43:29 devstack sudo[95241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:30 devstack sudo[95239]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee" returned: 0 in 0.337s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:30 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:43:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:30 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c81a36-674a-4138-a27e-dba4220cab65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f47447a-3c68-4cd3-8f57-4303ae483fee', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:30 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (688543f8-1c0e-4f8f-89f5-11bfe9c036b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:30 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] Volume volume-1f47447a-3c68-4cd3-8f57-4303ae483fee (1f47447a-3c68-4cd3-8f57-4303ae483fee): created successfully Jul 17 19:43:30 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (688543f8-1c0e-4f8f-89f5-11bfe9c036b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:30 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] Flow 'volume_create_manager' (79b3800d-bfc2-4e3b-b4c3-a1ffb8c076c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:43:30 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-aa24fb14-dbc0-4ce0-96eb-d1feb0a99ad9 tempest-VolumesGetTest-1683131619 None] Created volume successfully. Jul 17 19:43:30 devstack sudo[95241]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9a810071-c60c-417c-b575-35c6dacc4861 tempest-VolumesExtendTest-754674633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.257s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:30 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-9a810071-c60c-417c-b575-35c6dacc4861 tempest-VolumesExtendTest-754674633 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:43:30 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-9a810071-c60c-417c-b575-35c6dacc4861 tempest-VolumesExtendTest-754674633 None] Deleted volume successfully. Jul 17 19:43:30 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9a810071-c60c-417c-b575-35c6dacc4861 tempest-VolumesExtendTest-754674633 None] Lock "cinder-2fb71f3b-e606-4d4b-92d5-a3c323b39c57-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:43:31 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:43:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Flow 'volume_create_manager' (a6bf0b46-8c51-4d5b-a457-59a2e71252d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:43:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e13ab23-1c96-41ce-96a9-f951770a858f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e13ab23-1c96-41ce-96a9-f951770a858f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-899902777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eddc94c-5c36-421b-aa03-03f5b566d941,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='952812c7672047ec8b56b836145507ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=1f47447a-3c68-4cd3-8f57-4303ae483fee,status='creating',terminated_at=None,updated_at=2026-07-17T17:43:32Z,use_quota=True,user_id='f1e28d03a4524051a0f2bdf474adbaf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f42d93f0-97cc-457c-b9e9-296c068a8422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f42d93f0-97cc-457c-b9e9-296c068a8422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064a20b5-afbc-4b41-aacd-12503fa41e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064a20b5-afbc-4b41-aacd-12503fa41e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0eddc94c-5c36-421b-aa03-03f5b566d941', 'volume_name': 'volume-0eddc94c-5c36-421b-aa03-03f5b566d941', 'volume_size': 1, 'source_volid': '1f47447a-3c68-4cd3-8f57-4303ae483fee', 'source_volstatus': 'available'}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aad62970-77e5-4752-a9d6-6ea2e9cf1967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aad62970-77e5-4752-a9d6-6ea2e9cf1967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d0f53a-699e-4bac-b8e0-0211db176f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:32 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Volume 0eddc94c-5c36-421b-aa03-03f5b566d941: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0eddc94c-5c36-421b-aa03-03f5b566d941', 'volume_size': 1, 'source_volid': '1f47447a-3c68-4cd3-8f57-4303ae483fee', 'source_volstatus': 'available'} Jul 17 19:43:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:32 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Cloning volume 1f47447a-3c68-4cd3-8f57-4303ae483fee to volume 0eddc94c-5c36-421b-aa03-03f5b566d941 Jul 17 19:43:32 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Creating offline snapshot 7cf08959-f6c5-4d05-b125-196d9f6de0e9 of volume 1f47447a-3c68-4cd3-8f57-4303ae483fee {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:43:32 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01a99cb-a673-4361-b683-4c7a4086a40b]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:43:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:32 devstack sudo[95245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee Jul 17 19:43:32 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:32 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee" returned: 0 in 0.578s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee.7cf08959-f6c5-4d05-b125-196d9f6de0e9 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:32 devstack sudo[95251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee.7cf08959-f6c5-4d05-b125-196d9f6de0e9 1G Jul 17 19:43:32 devstack sudo[95251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:33 devstack sudo[95251]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee.7cf08959-f6c5-4d05-b125-196d9f6de0e9 1G" returned: 0 in 0.600s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f47447a-3c68-4cd3-8f57-4303ae483fee -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee.7cf08959-f6c5-4d05-b125-196d9f6de0e9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:33 devstack sudo[95257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f47447a-3c68-4cd3-8f57-4303ae483fee -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee.7cf08959-f6c5-4d05-b125-196d9f6de0e9 Jul 17 19:43:33 devstack sudo[95257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:33 devstack sudo[95257]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f47447a-3c68-4cd3-8f57-4303ae483fee -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee.7cf08959-f6c5-4d05-b125-196d9f6de0e9" returned: 0 in 0.451s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:33 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee.7cf08959-f6c5-4d05-b125-196d9f6de0e9 is being set with open permissions: ugo+rw Jul 17 19:43:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee.7cf08959-f6c5-4d05-b125-196d9f6de0e9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:33 devstack sudo[95262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee.7cf08959-f6c5-4d05-b125-196d9f6de0e9 Jul 17 19:43:33 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:34 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee.7cf08959-f6c5-4d05-b125-196d9f6de0e9" returned: 0 in 0.352s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:34 devstack sudo[95265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee.info Jul 17 19:43:34 devstack sudo[95265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:34 devstack sudo[95265]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee.info" returned: 0 in 0.322s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:34 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee.info is being set with open permissions: ugo+rw Jul 17 19:43:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:34 devstack sudo[95268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee.info Jul 17 19:43:34 devstack sudo[95268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:34 devstack sudo[95268]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee.info" returned: 0 in 0.390s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:34 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Acquiring lock "cinder-quobyte-0eddc94c-5c36-421b-aa03-03f5b566d941" by "_copy_volume_from_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:34 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Lock "cinder-quobyte-0eddc94c-5c36-421b-aa03-03f5b566d941" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:34 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] snapshot: 7cf08959-f6c5-4d05-b125-196d9f6de0e9, volume: 0eddc94c-5c36-421b-aa03-03f5b566d941, {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 19:43:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:34 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:43:34 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:43:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:34 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[74031bd6-9e04-427a-a59a-6f411087bf31]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:43:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee.7cf08959-f6c5-4d05-b125-196d9f6de0e9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:35 devstack sudo[95271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee.7cf08959-f6c5-4d05-b125-196d9f6de0e9 Jul 17 19:43:35 devstack sudo[95271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:35 devstack sudo[95271]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee.7cf08959-f6c5-4d05-b125-196d9f6de0e9" returned: 0 in 0.545s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:35 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f47447a-3c68-4cd3-8f57-4303ae483fee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:43:35 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 19:43:35 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Creating direct copy from snapshot {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 19:43:35 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d5bd6a-8e54-4e2d-9ca4-b3aa523dee63]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:43:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:35 devstack sudo[95276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee Jul 17 19:43:35 devstack sudo[95276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:36 devstack sudo[95276]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee" returned: 0 in 0.528s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:36 devstack cinder-volume[87726]: DEBUG cinder.utils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Path /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0eddc94c-5c36-421b-aa03-03f5b566d941 not found in is_blk_device check {{(pid=87726) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 19:43:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0eddc94c-5c36-421b-aa03-03f5b566d941 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:36 devstack sudo[95284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0eddc94c-5c36-421b-aa03-03f5b566d941 Jul 17 19:43:36 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:43 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0eddc94c-5c36-421b-aa03-03f5b566d941" returned: 0 in 7.219s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:43 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3bb975-b554-41cb-a62d-bb8a4acc013b]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:43:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:43 devstack sudo[95319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee Jul 17 19:43:43 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:43 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee" returned: 0 in 0.571s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:43 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Image conversion details: src /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee, size 1024.00 MB, duration 7.22 sec, destination /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0eddc94c-5c36-421b-aa03-03f5b566d941 {{(pid=87726) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 19:43:43 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Converted 1024.00 MB image at 141.81 MB/s Jul 17 19:43:43 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0eddc94c-5c36-421b-aa03-03f5b566d941 is being set with open permissions: ugo+rw Jul 17 19:43:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0eddc94c-5c36-421b-aa03-03f5b566d941 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:43 devstack sudo[95324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0eddc94c-5c36-421b-aa03-03f5b566d941 Jul 17 19:43:43 devstack sudo[95324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:44 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=93,cinder:INSERT=31,cinder:UPDATE=110,cinder:DELETE=12 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:43:44 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:INSERT=33,cinder:UPDATE=110,cinder:SELECT=77,cinder:DELETE=6 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:43:44 devstack sudo[95324]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0eddc94c-5c36-421b-aa03-03f5b566d941" returned: 0 in 0.342s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:44 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Lock "cinder-quobyte-0eddc94c-5c36-421b-aa03-03f5b566d941" released by "_copy_volume_from_snapshot" :: held 9.341s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:43:44 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Acquiring lock "cinder-quobyte-7cf08959-f6c5-4d05-b125-196d9f6de0e9" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:44 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Lock "cinder-quobyte-7cf08959-f6c5-4d05-b125-196d9f6de0e9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Deleting offline snapshot 7cf08959-f6c5-4d05-b125-196d9f6de0e9 of volume 1f47447a-3c68-4cd3-8f57-4303ae483fee {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:43:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] snapshot_file for this snap is: volume-1f47447a-3c68-4cd3-8f57-4303ae483fee.7cf08959-f6c5-4d05-b125-196d9f6de0e9 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:43:44 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac631a17-d3ff-4e08-8cd7-305f9a19c72e]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:43:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee.7cf08959-f6c5-4d05-b125-196d9f6de0e9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:44 devstack sudo[95328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee.7cf08959-f6c5-4d05-b125-196d9f6de0e9 Jul 17 19:43:44 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee.7cf08959-f6c5-4d05-b125-196d9f6de0e9" returned: 0 in 0.397s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f47447a-3c68-4cd3-8f57-4303ae483fee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:43:44 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:44 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73512fa-be97-4900-8c3e-f3dc2ee2452e]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:43:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:45 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee Jul 17 19:43:45 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:45 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee" returned: 0 in 0.889s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee.7cf08959-f6c5-4d05-b125-196d9f6de0e9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:45 devstack sudo[95398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee.7cf08959-f6c5-4d05-b125-196d9f6de0e9 Jul 17 19:43:45 devstack sudo[95398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:46 devstack sudo[95398]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee.7cf08959-f6c5-4d05-b125-196d9f6de0e9" returned: 0 in 0.673s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee.7cf08959-f6c5-4d05-b125-196d9f6de0e9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:46 devstack sudo[95445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee.7cf08959-f6c5-4d05-b125-196d9f6de0e9 Jul 17 19:43:46 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:46 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:43:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] Flow 'volume_create_manager' (8fb2d942-caa0-4c54-9670-514bc82a3340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:43:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9821f19e-3bc0-4e21-87d4-5c722a1c72d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9821f19e-3bc0-4e21-87d4-5c722a1c72d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1904006508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80408400-349e-470a-ab7f-278a164c503e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7289a88d755f4765aa311aba375ba6ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:43:47Z,use_quota=True,user_id='fef4e15a35a943e0bd04dcbeaef545db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b6d928-ada0-487c-a159-a59d64f663f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b6d928-ada0-487c-a159-a59d64f663f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d49da7d9-88de-4a9f-984c-c2d0513582af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d49da7d9-88de-4a9f-984c-c2d0513582af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80408400-349e-470a-ab7f-278a164c503e', 'volume_name': 'volume-80408400-349e-470a-ab7f-278a164c503e', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e5e70e-9025-4dcb-9091-c5e889b4a6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e5e70e-9025-4dcb-9091-c5e889b4a6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (003ca4f6-daa1-4e55-8cfe-2cbd0dfd73a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:46 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] Volume 80408400-349e-470a-ab7f-278a164c503e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80408400-349e-470a-ab7f-278a164c503e', 'volume_size': 1} Jul 17 19:43:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:46 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee.7cf08959-f6c5-4d05-b125-196d9f6de0e9" returned: 0 in 0.557s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Lock "cinder-quobyte-7cf08959-f6c5-4d05-b125-196d9f6de0e9" released by "_delete_snapshot" :: held 2.653s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:43:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.934s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.092s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:47 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1904006508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80408400-349e-470a-ab7f-278a164c503e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7289a88d755f4765aa311aba375ba6ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:43:47Z,use_quota=True,user_id='fef4e15a35a943e0bd04dcbeaef545db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:43:47 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] Creating volume 80408400-349e-470a-ab7f-278a164c503e {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:43:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:47 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:43:47 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:43:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:47 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:43:47 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:43:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-80408400-349e-470a-ab7f-278a164c503e 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:47 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d0f53a-699e-4bac-b8e0-0211db176f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eddc94c-5c36-421b-aa03-03f5b566d941', 'volume_size': 1, 'source_volid': '1f47447a-3c68-4cd3-8f57-4303ae483fee', 'source_volstatus': 'available'}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:47 devstack sudo[95452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-80408400-349e-470a-ab7f-278a164c503e 1073741824 Jul 17 19:43:47 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:47 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffee2422-4e9f-4511-af8a-b654c5a76370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:47 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Volume volume-0eddc94c-5c36-421b-aa03-03f5b566d941 (0eddc94c-5c36-421b-aa03-03f5b566d941): created successfully Jul 17 19:43:47 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffee2422-4e9f-4511-af8a-b654c5a76370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:47 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Flow 'volume_create_manager' (a6bf0b46-8c51-4d5b-a457-59a2e71252d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:43:47 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-074f3192-b588-4692-b074-33f6408efb5b tempest-VolumesGetTest-1683131619 None] Created volume successfully. Jul 17 19:43:47 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-80408400-349e-470a-ab7f-278a164c503e 1073741824" returned: 0 in 0.565s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-80408400-349e-470a-ab7f-278a164c503e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:47 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-80408400-349e-470a-ab7f-278a164c503e Jul 17 19:43:47 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:47 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-80408400-349e-470a-ab7f-278a164c503e" returned: 0 in 0.327s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:47 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:43:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:47 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (003ca4f6-daa1-4e55-8cfe-2cbd0dfd73a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80408400-349e-470a-ab7f-278a164c503e', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:47 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb276ef5-fc87-4121-9e58-c0b503691cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:48 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] Volume volume-80408400-349e-470a-ab7f-278a164c503e (80408400-349e-470a-ab7f-278a164c503e): created successfully Jul 17 19:43:48 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb276ef5-fc87-4121-9e58-c0b503691cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:48 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] Flow 'volume_create_manager' (8fb2d942-caa0-4c54-9670-514bc82a3340) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:43:48 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-9962a345-a931-42e0-b5fa-d10bdb6a1781 tempest-ProjectReaderTests-1819576110 None] Created volume successfully. Jul 17 19:43:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-de64018f-aa3b-493f-93a4-fb5766971716 tempest-ProjectReaderTests-1819576110 None] Acquiring lock "cinder-80408400-349e-470a-ab7f-278a164c503e-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-de64018f-aa3b-493f-93a4-fb5766971716 tempest-ProjectReaderTests-1819576110 None] Lock "cinder-80408400-349e-470a-ab7f-278a164c503e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:49 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:43:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] Flow 'volume_create_manager' (f4728c01-1f92-4f61-90ea-e64bcc967a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:43:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f966f3-4792-4bd6-bce5-45d422a02508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f966f3-4792-4bd6-bce5-45d422a02508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:43:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-444032912',display_name='tempest-VolumesGetTest-Volume-1541266019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ab22cac-5d4c-4037-b177-931bb6926e9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952812c7672047ec8b56b836145507ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:43:49Z,use_quota=True,user_id='f1e28d03a4524051a0f2bdf474adbaf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d599ab40-ba97-4eec-a1d4-eab0c069bf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d599ab40-ba97-4eec-a1d4-eab0c069bf7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3503493f-468c-40d1-b96f-f28076767b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3503493f-468c-40d1-b96f-f28076767b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ab22cac-5d4c-4037-b177-931bb6926e9e', 'volume_name': 'volume-7ab22cac-5d4c-4037-b177-931bb6926e9e', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9e0fd21-0c9c-459b-8f3b-4fb69c4f40dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9e0fd21-0c9c-459b-8f3b-4fb69c4f40dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f23571-e035-452d-a11a-185341fd0760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:49 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] Volume 7ab22cac-5d4c-4037-b177-931bb6926e9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ab22cac-5d4c-4037-b177-931bb6926e9e', 'volume_size': 1} Jul 17 19:43:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:49 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:43:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-444032912',display_name='tempest-VolumesGetTest-Volume-1541266019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ab22cac-5d4c-4037-b177-931bb6926e9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952812c7672047ec8b56b836145507ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:43:49Z,use_quota=True,user_id='f1e28d03a4524051a0f2bdf474adbaf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:43:49 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] Creating volume 7ab22cac-5d4c-4037-b177-931bb6926e9e {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:43:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:49 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:43:49 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:43:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:49 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:43:49 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:43:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7ab22cac-5d4c-4037-b177-931bb6926e9e 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-de64018f-aa3b-493f-93a4-fb5766971716 tempest-ProjectReaderTests-1819576110 None] Acquiring lock "cinder-quobyte-80408400-349e-470a-ab7f-278a164c503e" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:49 devstack sudo[95462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7ab22cac-5d4c-4037-b177-931bb6926e9e 1073741824 Jul 17 19:43:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-de64018f-aa3b-493f-93a4-fb5766971716 tempest-ProjectReaderTests-1819576110 None] Lock "cinder-quobyte-80408400-349e-470a-ab7f-278a164c503e" acquired by "delete_volume" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:49 devstack sudo[95462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:49 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[3758bbcf-ee5b-4785-9eb2-1b095e506eb1]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:43:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-de64018f-aa3b-493f-93a4-fb5766971716 tempest-ProjectReaderTests-1819576110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-80408400-349e-470a-ab7f-278a164c503e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:49 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-80408400-349e-470a-ab7f-278a164c503e Jul 17 19:43:49 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:50 devstack sudo[95462]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7ab22cac-5d4c-4037-b177-931bb6926e9e 1073741824" returned: 0 in 0.733s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7ab22cac-5d4c-4037-b177-931bb6926e9e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:50 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-de64018f-aa3b-493f-93a4-fb5766971716 tempest-ProjectReaderTests-1819576110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-80408400-349e-470a-ab7f-278a164c503e" returned: 0 in 0.744s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-de64018f-aa3b-493f-93a4-fb5766971716 tempest-ProjectReaderTests-1819576110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-80408400-349e-470a-ab7f-278a164c503e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:50 devstack sudo[95478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7ab22cac-5d4c-4037-b177-931bb6926e9e Jul 17 19:43:50 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:50 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-80408400-349e-470a-ab7f-278a164c503e Jul 17 19:43:50 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:50 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-de64018f-aa3b-493f-93a4-fb5766971716 tempest-ProjectReaderTests-1819576110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-80408400-349e-470a-ab7f-278a164c503e" returned: 0 in 0.439s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:50 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-de64018f-aa3b-493f-93a4-fb5766971716 tempest-ProjectReaderTests-1819576110 None] Lock "cinder-quobyte-80408400-349e-470a-ab7f-278a164c503e" released by "delete_volume" :: held 1.267s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:43:50 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7ab22cac-5d4c-4037-b177-931bb6926e9e" returned: 0 in 0.628s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:50 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:43:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:50 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f23571-e035-452d-a11a-185341fd0760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ab22cac-5d4c-4037-b177-931bb6926e9e', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:50 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b3ed3d-16fa-4d84-8a30-98b2a40a5902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:50 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-de64018f-aa3b-493f-93a4-fb5766971716 tempest-ProjectReaderTests-1819576110 None] Created reservations ['04aab21d-931d-498e-99aa-351a3eafcf9a', 'f9e462ad-0b8c-4281-95a5-c7d23f7fe1af', '0a546cd5-4e10-40ca-aba4-f7f87304e1f3', '551e9815-f6ad-43ac-bee3-9bd0422a1cc6'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:43:50 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] Volume volume-7ab22cac-5d4c-4037-b177-931bb6926e9e (7ab22cac-5d4c-4037-b177-931bb6926e9e): created successfully Jul 17 19:43:50 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b3ed3d-16fa-4d84-8a30-98b2a40a5902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:50 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] Flow 'volume_create_manager' (f4728c01-1f92-4f61-90ea-e64bcc967a6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:43:50 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-70b02361-e7df-4386-b9ec-efc46c9427ee tempest-VolumesGetTest-1683131619 None] Created volume successfully. Jul 17 19:43:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-de64018f-aa3b-493f-93a4-fb5766971716 tempest-ProjectReaderTests-1819576110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-de64018f-aa3b-493f-93a4-fb5766971716 tempest-ProjectReaderTests-1819576110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:51 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-de64018f-aa3b-493f-93a4-fb5766971716 tempest-ProjectReaderTests-1819576110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:43:51 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-de64018f-aa3b-493f-93a4-fb5766971716 tempest-ProjectReaderTests-1819576110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:43:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-de64018f-aa3b-493f-93a4-fb5766971716 tempest-ProjectReaderTests-1819576110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-de64018f-aa3b-493f-93a4-fb5766971716 tempest-ProjectReaderTests-1819576110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:51 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:43:51 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:51 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-de64018f-aa3b-493f-93a4-fb5766971716 tempest-ProjectReaderTests-1819576110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.368s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:51 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-de64018f-aa3b-493f-93a4-fb5766971716 tempest-ProjectReaderTests-1819576110 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:43:51 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-de64018f-aa3b-493f-93a4-fb5766971716 tempest-ProjectReaderTests-1819576110 None] Deleted volume successfully. Jul 17 19:43:51 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-de64018f-aa3b-493f-93a4-fb5766971716 tempest-ProjectReaderTests-1819576110 None] Lock "cinder-80408400-349e-470a-ab7f-278a164c503e-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:43:51 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-bbc8149a-1b2f-4c17-ae1f-88dfdb274084 tempest-VolumesGetTest-1683131619 None] Acquiring lock "cinder-7ab22cac-5d4c-4037-b177-931bb6926e9e-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:51 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-bbc8149a-1b2f-4c17-ae1f-88dfdb274084 tempest-VolumesGetTest-1683131619 None] Lock "cinder-7ab22cac-5d4c-4037-b177-931bb6926e9e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:51 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-bbc8149a-1b2f-4c17-ae1f-88dfdb274084 tempest-VolumesGetTest-1683131619 None] Acquiring lock "cinder-quobyte-7ab22cac-5d4c-4037-b177-931bb6926e9e" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:51 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-bbc8149a-1b2f-4c17-ae1f-88dfdb274084 tempest-VolumesGetTest-1683131619 None] Lock "cinder-quobyte-7ab22cac-5d4c-4037-b177-931bb6926e9e" acquired by "delete_volume" :: waited 0.028s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:51 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[761cdc5a-7cc9-4389-a590-eb359e533f6b]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:43:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bbc8149a-1b2f-4c17-ae1f-88dfdb274084 tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7ab22cac-5d4c-4037-b177-931bb6926e9e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:51 devstack sudo[95510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7ab22cac-5d4c-4037-b177-931bb6926e9e Jul 17 19:43:51 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:52 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bbc8149a-1b2f-4c17-ae1f-88dfdb274084 tempest-VolumesGetTest-1683131619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7ab22cac-5d4c-4037-b177-931bb6926e9e" returned: 0 in 0.556s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bbc8149a-1b2f-4c17-ae1f-88dfdb274084 tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7ab22cac-5d4c-4037-b177-931bb6926e9e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:52 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7ab22cac-5d4c-4037-b177-931bb6926e9e Jul 17 19:43:52 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:52 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:43:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] Flow 'volume_create_manager' (95a0bbc6-ee16-4483-ac18-9d00a2d5e06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:43:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be87c649-8d31-41ff-a8cd-8ab4e6033a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be87c649-8d31-41ff-a8cd-8ab4e6033a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-757217900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=550be88b-7e5d-41a7-a28e-8405d3c38b41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7289a88d755f4765aa311aba375ba6ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:43:52Z,use_quota=True,user_id='fef4e15a35a943e0bd04dcbeaef545db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc95742-5fdd-4658-a19b-15d15103f451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc95742-5fdd-4658-a19b-15d15103f451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4552d2-02b1-4a84-b1f4-d40b6db2289e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4552d2-02b1-4a84-b1f4-d40b6db2289e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '550be88b-7e5d-41a7-a28e-8405d3c38b41', 'volume_name': 'volume-550be88b-7e5d-41a7-a28e-8405d3c38b41', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e94436-249f-4142-b2e2-0b776c4e8416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e94436-249f-4142-b2e2-0b776c4e8416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f36ef819-8877-4f2f-b249-832e622e4d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:52 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] Volume 550be88b-7e5d-41a7-a28e-8405d3c38b41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-550be88b-7e5d-41a7-a28e-8405d3c38b41', 'volume_size': 1} Jul 17 19:43:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:52 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-757217900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=550be88b-7e5d-41a7-a28e-8405d3c38b41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7289a88d755f4765aa311aba375ba6ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:43:52Z,use_quota=True,user_id='fef4e15a35a943e0bd04dcbeaef545db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:43:52 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] Creating volume 550be88b-7e5d-41a7-a28e-8405d3c38b41 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:43:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:52 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:43:52 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:43:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:52 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:43:52 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:43:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-550be88b-7e5d-41a7-a28e-8405d3c38b41 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:52 devstack sudo[95519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-550be88b-7e5d-41a7-a28e-8405d3c38b41 1073741824 Jul 17 19:43:52 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:52 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bbc8149a-1b2f-4c17-ae1f-88dfdb274084 tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7ab22cac-5d4c-4037-b177-931bb6926e9e" returned: 0 in 0.472s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:52 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-bbc8149a-1b2f-4c17-ae1f-88dfdb274084 tempest-VolumesGetTest-1683131619 None] Lock "cinder-quobyte-7ab22cac-5d4c-4037-b177-931bb6926e9e" released by "delete_volume" :: held 1.088s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:43:52 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-bbc8149a-1b2f-4c17-ae1f-88dfdb274084 tempest-VolumesGetTest-1683131619 None] Created reservations ['35f8ab8f-085e-4a11-8cdb-d348bebe18c0', 'eea2b80d-4fa1-49e4-b922-ee1c961c8df5', '1015b661-aa78-4e97-9d2e-bd136832e58b', 'fc02cf29-adbd-4dbf-8505-48b8ef20ee17'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:43:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-bbc8149a-1b2f-4c17-ae1f-88dfdb274084 tempest-VolumesGetTest-1683131619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-bbc8149a-1b2f-4c17-ae1f-88dfdb274084 tempest-VolumesGetTest-1683131619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:53 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-bbc8149a-1b2f-4c17-ae1f-88dfdb274084 tempest-VolumesGetTest-1683131619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:43:53 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-bbc8149a-1b2f-4c17-ae1f-88dfdb274084 tempest-VolumesGetTest-1683131619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:43:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-bbc8149a-1b2f-4c17-ae1f-88dfdb274084 tempest-VolumesGetTest-1683131619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bbc8149a-1b2f-4c17-ae1f-88dfdb274084 tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:53 devstack sudo[95524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:43:53 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:53 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-550be88b-7e5d-41a7-a28e-8405d3c38b41 1073741824" returned: 0 in 0.657s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:53 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bbc8149a-1b2f-4c17-ae1f-88dfdb274084 tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.384s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:53 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-bbc8149a-1b2f-4c17-ae1f-88dfdb274084 tempest-VolumesGetTest-1683131619 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:43:53 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-bbc8149a-1b2f-4c17-ae1f-88dfdb274084 tempest-VolumesGetTest-1683131619 None] Deleted volume successfully. Jul 17 19:43:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-550be88b-7e5d-41a7-a28e-8405d3c38b41 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:53 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-bbc8149a-1b2f-4c17-ae1f-88dfdb274084 tempest-VolumesGetTest-1683131619 None] Lock "cinder-7ab22cac-5d4c-4037-b177-931bb6926e9e-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:43:53 devstack sudo[95528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-550be88b-7e5d-41a7-a28e-8405d3c38b41 Jul 17 19:43:53 devstack sudo[95528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:53 devstack sudo[95528]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-550be88b-7e5d-41a7-a28e-8405d3c38b41" returned: 0 in 0.300s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:53 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:43:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:53 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f36ef819-8877-4f2f-b249-832e622e4d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-550be88b-7e5d-41a7-a28e-8405d3c38b41', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:53 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd9f2c88-d689-4e89-9e7d-841ced63a5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:53 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] Volume volume-550be88b-7e5d-41a7-a28e-8405d3c38b41 (550be88b-7e5d-41a7-a28e-8405d3c38b41): created successfully Jul 17 19:43:53 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd9f2c88-d689-4e89-9e7d-841ced63a5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:53 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] Flow 'volume_create_manager' (95a0bbc6-ee16-4483-ac18-9d00a2d5e06a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:43:53 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-90bda14c-33ec-41f9-bb17-a346cb3fbaf9 tempest-ProjectReaderTests-1819576110 None] Created volume successfully. Jul 17 19:43:54 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a8b1946e-e1e9-4ce4-be2c-e35d2d24a535 tempest-VolumesGetTest-1683131619 None] Acquiring lock "cinder-0eddc94c-5c36-421b-aa03-03f5b566d941-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:54 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a8b1946e-e1e9-4ce4-be2c-e35d2d24a535 tempest-VolumesGetTest-1683131619 None] Lock "cinder-0eddc94c-5c36-421b-aa03-03f5b566d941-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:54 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a8b1946e-e1e9-4ce4-be2c-e35d2d24a535 tempest-VolumesGetTest-1683131619 None] Acquiring lock "cinder-quobyte-0eddc94c-5c36-421b-aa03-03f5b566d941" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:54 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a8b1946e-e1e9-4ce4-be2c-e35d2d24a535 tempest-VolumesGetTest-1683131619 None] Lock "cinder-quobyte-0eddc94c-5c36-421b-aa03-03f5b566d941" acquired by "delete_volume" :: waited 0.023s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:54 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9f001e-b573-4e98-b90c-7583a77602b9]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:43:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a8b1946e-e1e9-4ce4-be2c-e35d2d24a535 tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0eddc94c-5c36-421b-aa03-03f5b566d941 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:54 devstack sudo[95533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0eddc94c-5c36-421b-aa03-03f5b566d941 Jul 17 19:43:54 devstack sudo[95533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:54 devstack sudo[95533]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a8b1946e-e1e9-4ce4-be2c-e35d2d24a535 tempest-VolumesGetTest-1683131619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0eddc94c-5c36-421b-aa03-03f5b566d941" returned: 0 in 0.396s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a8b1946e-e1e9-4ce4-be2c-e35d2d24a535 tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0eddc94c-5c36-421b-aa03-03f5b566d941 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:54 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-fc8c6ad3-9264-4e04-b1c1-8ae9c48c95f2 tempest-ProjectReaderTests-1819576110 None] Acquiring lock "cinder-550be88b-7e5d-41a7-a28e-8405d3c38b41-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:54 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0eddc94c-5c36-421b-aa03-03f5b566d941 Jul 17 19:43:54 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:54 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-fc8c6ad3-9264-4e04-b1c1-8ae9c48c95f2 tempest-ProjectReaderTests-1819576110 None] Lock "cinder-550be88b-7e5d-41a7-a28e-8405d3c38b41-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:54 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-fc8c6ad3-9264-4e04-b1c1-8ae9c48c95f2 tempest-ProjectReaderTests-1819576110 None] Acquiring lock "cinder-quobyte-550be88b-7e5d-41a7-a28e-8405d3c38b41" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:54 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-fc8c6ad3-9264-4e04-b1c1-8ae9c48c95f2 tempest-ProjectReaderTests-1819576110 None] Lock "cinder-quobyte-550be88b-7e5d-41a7-a28e-8405d3c38b41" acquired by "delete_volume" :: waited 0.025s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:54 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3718fbb-88c7-4ddc-9c78-63d040fcf691]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:43:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fc8c6ad3-9264-4e04-b1c1-8ae9c48c95f2 tempest-ProjectReaderTests-1819576110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-550be88b-7e5d-41a7-a28e-8405d3c38b41 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:54 devstack sudo[95541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-550be88b-7e5d-41a7-a28e-8405d3c38b41 Jul 17 19:43:54 devstack sudo[95541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:54 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a8b1946e-e1e9-4ce4-be2c-e35d2d24a535 tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0eddc94c-5c36-421b-aa03-03f5b566d941" returned: 0 in 0.351s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:54 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a8b1946e-e1e9-4ce4-be2c-e35d2d24a535 tempest-VolumesGetTest-1683131619 None] Lock "cinder-quobyte-0eddc94c-5c36-421b-aa03-03f5b566d941" released by "delete_volume" :: held 0.802s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:43:55 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-a8b1946e-e1e9-4ce4-be2c-e35d2d24a535 tempest-VolumesGetTest-1683131619 None] Created reservations ['60879716-123c-45ce-aed8-a915e6be7c16', '3357f140-7f96-4995-ae70-a93c0cd720c5', 'e6efbc75-ddd4-4d15-92ac-62aae141d486', '9754c544-eeaa-49ce-a994-6df792eaeb74'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:43:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a8b1946e-e1e9-4ce4-be2c-e35d2d24a535 tempest-VolumesGetTest-1683131619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a8b1946e-e1e9-4ce4-be2c-e35d2d24a535 tempest-VolumesGetTest-1683131619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:55 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a8b1946e-e1e9-4ce4-be2c-e35d2d24a535 tempest-VolumesGetTest-1683131619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:43:55 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a8b1946e-e1e9-4ce4-be2c-e35d2d24a535 tempest-VolumesGetTest-1683131619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:43:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a8b1946e-e1e9-4ce4-be2c-e35d2d24a535 tempest-VolumesGetTest-1683131619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a8b1946e-e1e9-4ce4-be2c-e35d2d24a535 tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:55 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:43:55 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:55 devstack sudo[95541]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fc8c6ad3-9264-4e04-b1c1-8ae9c48c95f2 tempest-ProjectReaderTests-1819576110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-550be88b-7e5d-41a7-a28e-8405d3c38b41" returned: 0 in 0.597s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fc8c6ad3-9264-4e04-b1c1-8ae9c48c95f2 tempest-ProjectReaderTests-1819576110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-550be88b-7e5d-41a7-a28e-8405d3c38b41 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:55 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-550be88b-7e5d-41a7-a28e-8405d3c38b41 Jul 17 19:43:55 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:55 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-58ac1e99-5cd7-4146-9d2f-637ab6491f9d tempest-VolumesGetTest-1683131619 None] Acquiring lock "cinder-1f47447a-3c68-4cd3-8f57-4303ae483fee-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:55 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-58ac1e99-5cd7-4146-9d2f-637ab6491f9d tempest-VolumesGetTest-1683131619 None] Lock "cinder-1f47447a-3c68-4cd3-8f57-4303ae483fee-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:55 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a8b1946e-e1e9-4ce4-be2c-e35d2d24a535 tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.453s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:55 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-a8b1946e-e1e9-4ce4-be2c-e35d2d24a535 tempest-VolumesGetTest-1683131619 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:43:55 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-a8b1946e-e1e9-4ce4-be2c-e35d2d24a535 tempest-VolumesGetTest-1683131619 None] Deleted volume successfully. Jul 17 19:43:55 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-58ac1e99-5cd7-4146-9d2f-637ab6491f9d tempest-VolumesGetTest-1683131619 None] Acquiring lock "cinder-quobyte-1f47447a-3c68-4cd3-8f57-4303ae483fee" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:55 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a8b1946e-e1e9-4ce4-be2c-e35d2d24a535 tempest-VolumesGetTest-1683131619 None] Lock "cinder-0eddc94c-5c36-421b-aa03-03f5b566d941-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:43:55 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-58ac1e99-5cd7-4146-9d2f-637ab6491f9d tempest-VolumesGetTest-1683131619 None] Lock "cinder-quobyte-1f47447a-3c68-4cd3-8f57-4303ae483fee" acquired by "delete_volume" :: waited 0.036s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:55 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa8b708-3624-4d03-bf68-2069300d5226]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:43:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-58ac1e99-5cd7-4146-9d2f-637ab6491f9d tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:55 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fc8c6ad3-9264-4e04-b1c1-8ae9c48c95f2 tempest-ProjectReaderTests-1819576110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-550be88b-7e5d-41a7-a28e-8405d3c38b41" returned: 0 in 0.496s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:55 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-fc8c6ad3-9264-4e04-b1c1-8ae9c48c95f2 tempest-ProjectReaderTests-1819576110 None] Lock "cinder-quobyte-550be88b-7e5d-41a7-a28e-8405d3c38b41" released by "delete_volume" :: held 1.143s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:43:55 devstack sudo[95559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee Jul 17 19:43:55 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:55 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-fc8c6ad3-9264-4e04-b1c1-8ae9c48c95f2 tempest-ProjectReaderTests-1819576110 None] Created reservations ['f173ddef-6396-4a2a-8ad8-b650b05b2239', 'c0557b0e-ea41-4afb-b605-b874324b0eaf', '86b4a5f1-80cc-4717-8281-50ba1c16e232', '1feb3be8-7a49-4f69-824b-1ffbc7b9680f'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:43:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-fc8c6ad3-9264-4e04-b1c1-8ae9c48c95f2 tempest-ProjectReaderTests-1819576110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-fc8c6ad3-9264-4e04-b1c1-8ae9c48c95f2 tempest-ProjectReaderTests-1819576110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:56 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-fc8c6ad3-9264-4e04-b1c1-8ae9c48c95f2 tempest-ProjectReaderTests-1819576110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:43:56 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-fc8c6ad3-9264-4e04-b1c1-8ae9c48c95f2 tempest-ProjectReaderTests-1819576110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:43:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-fc8c6ad3-9264-4e04-b1c1-8ae9c48c95f2 tempest-ProjectReaderTests-1819576110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fc8c6ad3-9264-4e04-b1c1-8ae9c48c95f2 tempest-ProjectReaderTests-1819576110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:56 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:43:56 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:56 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-58ac1e99-5cd7-4146-9d2f-637ab6491f9d tempest-VolumesGetTest-1683131619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee" returned: 0 in 0.505s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-58ac1e99-5cd7-4146-9d2f-637ab6491f9d tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:56 devstack sudo[95567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee Jul 17 19:43:56 devstack sudo[95567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:56 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fc8c6ad3-9264-4e04-b1c1-8ae9c48c95f2 tempest-ProjectReaderTests-1819576110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.299s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:56 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-fc8c6ad3-9264-4e04-b1c1-8ae9c48c95f2 tempest-ProjectReaderTests-1819576110 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:43:56 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-fc8c6ad3-9264-4e04-b1c1-8ae9c48c95f2 tempest-ProjectReaderTests-1819576110 None] Deleted volume successfully. Jul 17 19:43:56 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-fc8c6ad3-9264-4e04-b1c1-8ae9c48c95f2 tempest-ProjectReaderTests-1819576110 None] Lock "cinder-550be88b-7e5d-41a7-a28e-8405d3c38b41-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:43:56 devstack sudo[95567]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-58ac1e99-5cd7-4146-9d2f-637ab6491f9d tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1f47447a-3c68-4cd3-8f57-4303ae483fee" returned: 0 in 0.351s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:56 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-58ac1e99-5cd7-4146-9d2f-637ab6491f9d tempest-VolumesGetTest-1683131619 None] Lock "cinder-quobyte-1f47447a-3c68-4cd3-8f57-4303ae483fee" released by "delete_volume" :: held 0.943s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:43:56 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-58ac1e99-5cd7-4146-9d2f-637ab6491f9d tempest-VolumesGetTest-1683131619 None] Created reservations ['c725d290-ee3a-48ce-9cc6-2589c489ae18', 'dfda18fe-d307-4087-93a4-4c55c0e4c144', '2c2242e5-0eee-416d-910a-a9c6520c28a7', 'f5d06d4a-183e-4aed-ae10-7617de0dc8f7'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:43:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-58ac1e99-5cd7-4146-9d2f-637ab6491f9d tempest-VolumesGetTest-1683131619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-58ac1e99-5cd7-4146-9d2f-637ab6491f9d tempest-VolumesGetTest-1683131619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:56 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-58ac1e99-5cd7-4146-9d2f-637ab6491f9d tempest-VolumesGetTest-1683131619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:43:56 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-58ac1e99-5cd7-4146-9d2f-637ab6491f9d tempest-VolumesGetTest-1683131619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:43:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-58ac1e99-5cd7-4146-9d2f-637ab6491f9d tempest-VolumesGetTest-1683131619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-58ac1e99-5cd7-4146-9d2f-637ab6491f9d tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:56 devstack sudo[95571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:43:56 devstack sudo[95571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:57 devstack sudo[95571]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-58ac1e99-5cd7-4146-9d2f-637ab6491f9d tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.310s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:57 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-58ac1e99-5cd7-4146-9d2f-637ab6491f9d tempest-VolumesGetTest-1683131619 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:43:57 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-58ac1e99-5cd7-4146-9d2f-637ab6491f9d tempest-VolumesGetTest-1683131619 None] Deleted volume successfully. Jul 17 19:43:57 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-58ac1e99-5cd7-4146-9d2f-637ab6491f9d tempest-VolumesGetTest-1683131619 None] Lock "cinder-1f47447a-3c68-4cd3-8f57-4303ae483fee-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:43:57 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:43:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] Flow 'volume_create_manager' (cf144994-1f32-49ec-9371-d305eff74cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:43:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a26b73f2-e90e-49eb-8026-8c6f4abcd617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a26b73f2-e90e-49eb-8026-8c6f4abcd617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1433270800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df51b3a8-f6fe-4971-8385-d0bee46dc0b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7289a88d755f4765aa311aba375ba6ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:43:57Z,use_quota=True,user_id='fef4e15a35a943e0bd04dcbeaef545db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f40f8bb-14af-4422-bdf2-62ed2cb21d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f40f8bb-14af-4422-bdf2-62ed2cb21d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7fb500f-6408-4c1c-bf09-cf1d8a2207ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7fb500f-6408-4c1c-bf09-cf1d8a2207ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df51b3a8-f6fe-4971-8385-d0bee46dc0b5', 'volume_name': 'volume-df51b3a8-f6fe-4971-8385-d0bee46dc0b5', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c930e5c6-ef1f-4dd7-845b-134780a4cd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c930e5c6-ef1f-4dd7-845b-134780a4cd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba164b6-0ba1-46b3-ab65-49a91e13486d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:57 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] Volume df51b3a8-f6fe-4971-8385-d0bee46dc0b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df51b3a8-f6fe-4971-8385-d0bee46dc0b5', 'volume_size': 1} Jul 17 19:43:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:57 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1433270800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df51b3a8-f6fe-4971-8385-d0bee46dc0b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7289a88d755f4765aa311aba375ba6ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:43:57Z,use_quota=True,user_id='fef4e15a35a943e0bd04dcbeaef545db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:43:57 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] Creating volume df51b3a8-f6fe-4971-8385-d0bee46dc0b5 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:43:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:43:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:43:57 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:43:57 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:43:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:57 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:43:57 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:43:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-df51b3a8-f6fe-4971-8385-d0bee46dc0b5 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:57 devstack sudo[95574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-df51b3a8-f6fe-4971-8385-d0bee46dc0b5 1073741824 Jul 17 19:43:57 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:58 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-df51b3a8-f6fe-4971-8385-d0bee46dc0b5 1073741824" returned: 0 in 0.536s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-df51b3a8-f6fe-4971-8385-d0bee46dc0b5 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:58 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-df51b3a8-f6fe-4971-8385-d0bee46dc0b5 Jul 17 19:43:58 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:43:58 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Jul 17 19:43:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-df51b3a8-f6fe-4971-8385-d0bee46dc0b5" returned: 0 in 0.383s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:43:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:43:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:43:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba164b6-0ba1-46b3-ab65-49a91e13486d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df51b3a8-f6fe-4971-8385-d0bee46dc0b5', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800972a7-0a45-4312-a1cb-a0c42dcb6d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:58 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] Volume volume-df51b3a8-f6fe-4971-8385-d0bee46dc0b5 (df51b3a8-f6fe-4971-8385-d0bee46dc0b5): created successfully Jul 17 19:43:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800972a7-0a45-4312-a1cb-a0c42dcb6d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] Flow 'volume_create_manager' (cf144994-1f32-49ec-9371-d305eff74cd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:43:58 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-5ca58833-bd16-43e8-96e4-55b055dd51fa tempest-ProjectReaderTests-1819576110 None] Created volume successfully. Jul 17 19:43:58 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:43:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Flow 'volume_create_manager' (408e79ce-2319-4b87-a7f6-9955af97caaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:43:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c291218-cf48-4b6b-a45f-5078ce4efbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c291218-cf48-4b6b-a45f-5078ce4efbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1974923065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b0731a3-2ae1-4650-89e9-4c522d46c3a5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='952812c7672047ec8b56b836145507ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:43:59Z,use_quota=True,user_id='f1e28d03a4524051a0f2bdf474adbaf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae8a249-c0bf-4143-8e94-3edf78c2d1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae8a249-c0bf-4143-8e94-3edf78c2d1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ccdb614-2034-4b29-b290-b5f22207a2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:58 devstack cinder-volume[87726]: DEBUG cinder.image.glance [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Creating Keystone auth plugin from conf {{(pid=87726) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 19:43:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ccdb614-2034-4b29-b290-b5f22207a2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0b0731a3-2ae1-4650-89e9-4c522d46c3a5', 'volume_name': 'volume-0b0731a3-2ae1-4650-89e9-4c522d46c3a5', 'volume_size': 1, 'image_id': '8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f9f36413d75c4b9e8be9b78b4ce9c162', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'created_at': datetime.datetime(2026, 7, 17, 17, 31, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 17, 31, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a5bb98-a8a6-4e5a-85ae-7c3d86c9b2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a5bb98-a8a6-4e5a-85ae-7c3d86c9b2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:43:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d450e4-108e-4422-8483-73d0d74bc892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:43:59 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Volume 0b0731a3-2ae1-4650-89e9-4c522d46c3a5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0b0731a3-2ae1-4650-89e9-4c522d46c3a5', 'volume_size': 1, 'image_id': '8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f9f36413d75c4b9e8be9b78b4ce9c162', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'created_at': datetime.datetime(2026, 7, 17, 17, 31, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 17, 31, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 17 19:43:59 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Trying to clone 0b0731a3-2ae1-4650-89e9-4c522d46c3a5 from image 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'metadata': {}}]). {{(pid=87726) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 19:43:59 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-111a5d53-3ece-402f-9151-d692d7b486f1 tempest-ProjectReaderTests-1819576110 None] Acquiring lock "cinder-df51b3a8-f6fe-4971-8385-d0bee46dc0b5-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:59 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-111a5d53-3ece-402f-9151-d692d7b486f1 tempest-ProjectReaderTests-1819576110 None] Lock "cinder-df51b3a8-f6fe-4971-8385-d0bee46dc0b5-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:59 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-111a5d53-3ece-402f-9151-d692d7b486f1 tempest-ProjectReaderTests-1819576110 None] Acquiring lock "cinder-quobyte-df51b3a8-f6fe-4971-8385-d0bee46dc0b5" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:43:59 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-111a5d53-3ece-402f-9151-d692d7b486f1 tempest-ProjectReaderTests-1819576110 None] Lock "cinder-quobyte-df51b3a8-f6fe-4971-8385-d0bee46dc0b5" acquired by "delete_volume" :: waited 0.030s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:43:59 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae7e1db-a5ae-4e72-b075-19808c06f572]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:43:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-111a5d53-3ece-402f-9151-d692d7b486f1 tempest-ProjectReaderTests-1819576110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-df51b3a8-f6fe-4971-8385-d0bee46dc0b5 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:43:59 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_4engkt9ddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87726) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 19:43:59 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Image download 20.69 MB at 20.69 MB/s Jul 17 19:44:00 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[342ca7ba-dd13-4f28-b9c1-82df682c9989]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:44:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_4engkt9ddevstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:00 devstack sudo[95611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-df51b3a8-f6fe-4971-8385-d0bee46dc0b5 Jul 17 19:44:00 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:00 devstack sudo[95613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_4engkt9ddevstack@QuobyteHD Jul 17 19:44:00 devstack sudo[95613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:00 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-111a5d53-3ece-402f-9151-d692d7b486f1 tempest-ProjectReaderTests-1819576110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-df51b3a8-f6fe-4971-8385-d0bee46dc0b5" returned: 0 in 0.457s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-111a5d53-3ece-402f-9151-d692d7b486f1 tempest-ProjectReaderTests-1819576110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-df51b3a8-f6fe-4971-8385-d0bee46dc0b5 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:00 devstack sudo[95618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-df51b3a8-f6fe-4971-8385-d0bee46dc0b5 Jul 17 19:44:00 devstack sudo[95618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:00 devstack sudo[95613]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_4engkt9ddevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:00 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Temporary image 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 is fetched for user f1e28d03a4524051a0f2bdf474adbaf3. {{(pid=87726) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 19:44:00 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d943b79-2431-4ddd-b4a6-9242c07044d9]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:44:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_4engkt9ddevstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:00 devstack sudo[95618]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-111a5d53-3ece-402f-9151-d692d7b486f1 tempest-ProjectReaderTests-1819576110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-df51b3a8-f6fe-4971-8385-d0bee46dc0b5" returned: 0 in 0.316s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:00 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-111a5d53-3ece-402f-9151-d692d7b486f1 tempest-ProjectReaderTests-1819576110 None] Lock "cinder-quobyte-df51b3a8-f6fe-4971-8385-d0bee46dc0b5" released by "delete_volume" :: held 0.835s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:44:00 devstack sudo[95624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_4engkt9ddevstack@QuobyteHD Jul 17 19:44:00 devstack sudo[95624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:00 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-111a5d53-3ece-402f-9151-d692d7b486f1 tempest-ProjectReaderTests-1819576110 None] Created reservations ['9dcb5dcd-8ec2-4e44-b7fc-ee6394cbf825', '0b6087e6-ba04-480a-94e2-186d508a5929', '16f2f1e2-e811-403e-a48f-d44c8643ff09', '53826b90-e6b6-447e-a1cb-13433b84dc8c'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:44:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-111a5d53-3ece-402f-9151-d692d7b486f1 tempest-ProjectReaderTests-1819576110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-111a5d53-3ece-402f-9151-d692d7b486f1 tempest-ProjectReaderTests-1819576110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:00 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-111a5d53-3ece-402f-9151-d692d7b486f1 tempest-ProjectReaderTests-1819576110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:44:00 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-111a5d53-3ece-402f-9151-d692d7b486f1 tempest-ProjectReaderTests-1819576110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:44:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-111a5d53-3ece-402f-9151-d692d7b486f1 tempest-ProjectReaderTests-1819576110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-111a5d53-3ece-402f-9151-d692d7b486f1 tempest-ProjectReaderTests-1819576110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:00 devstack sudo[95637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:44:00 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:01 devstack sudo[95624]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_4engkt9ddevstack@QuobyteHD" returned: 0 in 0.527s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:01 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1974923065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b0731a3-2ae1-4650-89e9-4c522d46c3a5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='952812c7672047ec8b56b836145507ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:43:59Z,use_quota=True,user_id='f1e28d03a4524051a0f2bdf474adbaf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:44:01 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Creating volume 0b0731a3-2ae1-4650-89e9-4c522d46c3a5 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:44:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:01 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:44:01 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:44:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:01 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:44:01 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:44:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0b0731a3-2ae1-4650-89e9-4c522d46c3a5 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:01 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0b0731a3-2ae1-4650-89e9-4c522d46c3a5 1073741824 Jul 17 19:44:01 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:01 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-111a5d53-3ece-402f-9151-d692d7b486f1 tempest-ProjectReaderTests-1819576110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.372s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:01 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-111a5d53-3ece-402f-9151-d692d7b486f1 tempest-ProjectReaderTests-1819576110 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:44:01 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-111a5d53-3ece-402f-9151-d692d7b486f1 tempest-ProjectReaderTests-1819576110 None] Deleted volume successfully. Jul 17 19:44:01 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-111a5d53-3ece-402f-9151-d692d7b486f1 tempest-ProjectReaderTests-1819576110 None] Lock "cinder-df51b3a8-f6fe-4971-8385-d0bee46dc0b5-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:44:01 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:44:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] Flow 'volume_create_manager' (a797d1a5-6bb3-479c-b1ca-99ba3f80954a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:44:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb0fd86-0ced-4b80-8b86-f67c9f996b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb0fd86-0ced-4b80-8b86-f67c9f996b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-279752959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02622e06-ee67-4b5b-bce5-12c9a50ae516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7289a88d755f4765aa311aba375ba6ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:44:02Z,use_quota=True,user_id='fef4e15a35a943e0bd04dcbeaef545db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (746c1d86-5881-4bf2-8331-4a9191f1e19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (746c1d86-5881-4bf2-8331-4a9191f1e19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5da7b4d-f352-4e27-832d-2e6f0b722992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5da7b4d-f352-4e27-832d-2e6f0b722992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02622e06-ee67-4b5b-bce5-12c9a50ae516', 'volume_name': 'volume-02622e06-ee67-4b5b-bce5-12c9a50ae516', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f0cc2bb-e875-43a9-b7dd-e9a0269506f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:01 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f0cc2bb-e875-43a9-b7dd-e9a0269506f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc8ff3f-cff9-4e9d-9b07-9c0737cdadc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:01 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] Volume 02622e06-ee67-4b5b-bce5-12c9a50ae516: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02622e06-ee67-4b5b-bce5-12c9a50ae516', 'volume_size': 1} Jul 17 19:44:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0b0731a3-2ae1-4650-89e9-4c522d46c3a5 1073741824" returned: 0 in 0.751s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0b0731a3-2ae1-4650-89e9-4c522d46c3a5 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:01 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0b0731a3-2ae1-4650-89e9-4c522d46c3a5 Jul 17 19:44:01 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:02 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0b0731a3-2ae1-4650-89e9-4c522d46c3a5" returned: 0 in 0.282s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:02 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:44:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.321s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:02 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-279752959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02622e06-ee67-4b5b-bce5-12c9a50ae516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7289a88d755f4765aa311aba375ba6ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:44:02Z,use_quota=True,user_id='fef4e15a35a943e0bd04dcbeaef545db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:44:02 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] Creating volume 02622e06-ee67-4b5b-bce5-12c9a50ae516 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:44:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:02 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:44:02 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:44:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:02 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:44:02 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:44:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-02622e06-ee67-4b5b-bce5-12c9a50ae516 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:02 devstack sudo[95658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-02622e06-ee67-4b5b-bce5-12c9a50ae516 1073741824 Jul 17 19:44:02 devstack sudo[95658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:02 devstack cinder-volume[87726]: DEBUG cinder.volume.volume_utils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Attempting download of 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'metadata': {}}])) to volume 0b0731a3-2ae1-4650-89e9-4c522d46c3a5. {{(pid=87726) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 19:44:02 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[26256200-1b58-4f9b-b17a-0a19604f68d2]: (4, 'raw') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:44:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_sjolaz_q {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:02 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_sjolaz_q Jul 17 19:44:02 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:02 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_sjolaz_q" returned: 0 in 0.359s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_sjolaz_q {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:02 devstack sudo[95658]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-02622e06-ee67-4b5b-bce5-12c9a50ae516 1073741824" returned: 0 in 0.528s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-02622e06-ee67-4b5b-bce5-12c9a50ae516 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:02 devstack sudo[95667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_sjolaz_q Jul 17 19:44:02 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:02 devstack sudo[95669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-02622e06-ee67-4b5b-bce5-12c9a50ae516 Jul 17 19:44:02 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:03 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_sjolaz_q" returned: 1 in 0.384s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_sjolaz_q' failed. Not Retrying. {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 19:44:03 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[217740b5-d229-43e8-ae52-35db4aabb7da]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:44:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_4engkt9ddevstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:03 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-02622e06-ee67-4b5b-bce5-12c9a50ae516" returned: 0 in 0.313s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:03 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:44:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:03 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc8ff3f-cff9-4e9d-9b07-9c0737cdadc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02622e06-ee67-4b5b-bce5-12c9a50ae516', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:03 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf3b8dfe-7d70-4c70-89a6-2019536a39c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:03 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] Volume volume-02622e06-ee67-4b5b-bce5-12c9a50ae516 (02622e06-ee67-4b5b-bce5-12c9a50ae516): created successfully Jul 17 19:44:03 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf3b8dfe-7d70-4c70-89a6-2019536a39c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:03 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] Flow 'volume_create_manager' (a797d1a5-6bb3-479c-b1ca-99ba3f80954a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:44:03 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-cf638cd8-a9e4-4d7d-87dc-331ca9de720d tempest-ProjectReaderTests-1819576110 None] Created volume successfully. Jul 17 19:44:03 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_4engkt9ddevstack@QuobyteHD Jul 17 19:44:03 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:03 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_4engkt9ddevstack@QuobyteHD" returned: 0 in 0.481s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:03 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 was qcow2, converting to qcow2 {{(pid=87726) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 19:44:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_4engkt9ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0b0731a3-2ae1-4650-89e9-4c522d46c3a5 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:03 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_4engkt9ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0b0731a3-2ae1-4650-89e9-4c522d46c3a5 Jul 17 19:44:03 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:03 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-efe2b664-4df7-4ce7-b562-f585b1118628 tempest-ProjectReaderTests-1819576110 None] Acquiring lock "cinder-02622e06-ee67-4b5b-bce5-12c9a50ae516-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:44:03 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-efe2b664-4df7-4ce7-b562-f585b1118628 tempest-ProjectReaderTests-1819576110 None] Lock "cinder-02622e06-ee67-4b5b-bce5-12c9a50ae516-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:44:04 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-efe2b664-4df7-4ce7-b562-f585b1118628 tempest-ProjectReaderTests-1819576110 None] Acquiring lock "cinder-quobyte-02622e06-ee67-4b5b-bce5-12c9a50ae516" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:44:04 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-efe2b664-4df7-4ce7-b562-f585b1118628 tempest-ProjectReaderTests-1819576110 None] Lock "cinder-quobyte-02622e06-ee67-4b5b-bce5-12c9a50ae516" acquired by "delete_volume" :: waited 0.044s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:44:04 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[3010e29a-7d12-493d-97b8-50ce007cf6b2]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:44:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-efe2b664-4df7-4ce7-b562-f585b1118628 tempest-ProjectReaderTests-1819576110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-02622e06-ee67-4b5b-bce5-12c9a50ae516 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:04 devstack sudo[95744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-02622e06-ee67-4b5b-bce5-12c9a50ae516 Jul 17 19:44:04 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:04 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-efe2b664-4df7-4ce7-b562-f585b1118628 tempest-ProjectReaderTests-1819576110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-02622e06-ee67-4b5b-bce5-12c9a50ae516" returned: 0 in 0.614s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-efe2b664-4df7-4ce7-b562-f585b1118628 tempest-ProjectReaderTests-1819576110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-02622e06-ee67-4b5b-bce5-12c9a50ae516 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:04 devstack sudo[95757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-02622e06-ee67-4b5b-bce5-12c9a50ae516 Jul 17 19:44:04 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:05 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-efe2b664-4df7-4ce7-b562-f585b1118628 tempest-ProjectReaderTests-1819576110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-02622e06-ee67-4b5b-bce5-12c9a50ae516" returned: 0 in 0.356s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-efe2b664-4df7-4ce7-b562-f585b1118628 tempest-ProjectReaderTests-1819576110 None] Lock "cinder-quobyte-02622e06-ee67-4b5b-bce5-12c9a50ae516" released by "delete_volume" :: held 1.069s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:44:05 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-efe2b664-4df7-4ce7-b562-f585b1118628 tempest-ProjectReaderTests-1819576110 None] Created reservations ['7bfda001-8e84-421d-ad89-4311f98ac914', '556a4ac8-93a4-45d4-a72c-5baf65e25099', '18d8628d-5f4b-462b-aaef-1ede3cedb913', '3f7b2b49-c3fe-4717-b8fc-3f603e5328c9'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:44:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-efe2b664-4df7-4ce7-b562-f585b1118628 tempest-ProjectReaderTests-1819576110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-efe2b664-4df7-4ce7-b562-f585b1118628 tempest-ProjectReaderTests-1819576110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:05 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-efe2b664-4df7-4ce7-b562-f585b1118628 tempest-ProjectReaderTests-1819576110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:44:05 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-efe2b664-4df7-4ce7-b562-f585b1118628 tempest-ProjectReaderTests-1819576110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:44:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-efe2b664-4df7-4ce7-b562-f585b1118628 tempest-ProjectReaderTests-1819576110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-efe2b664-4df7-4ce7-b562-f585b1118628 tempest-ProjectReaderTests-1819576110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:05 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:44:05 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:05 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-efe2b664-4df7-4ce7-b562-f585b1118628 tempest-ProjectReaderTests-1819576110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.305s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:05 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-efe2b664-4df7-4ce7-b562-f585b1118628 tempest-ProjectReaderTests-1819576110 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:44:05 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-efe2b664-4df7-4ce7-b562-f585b1118628 tempest-ProjectReaderTests-1819576110 None] Deleted volume successfully. Jul 17 19:44:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-efe2b664-4df7-4ce7-b562-f585b1118628 tempest-ProjectReaderTests-1819576110 None] Lock "cinder-02622e06-ee67-4b5b-bce5-12c9a50ae516-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:44:06 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_4engkt9ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0b0731a3-2ae1-4650-89e9-4c522d46c3a5" returned: 0 in 2.718s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:06 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_4engkt9ddevstack@QuobyteHD, size 112.00 MB, duration 2.72 sec, destination /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0b0731a3-2ae1-4650-89e9-4c522d46c3a5 {{(pid=87726) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 19:44:06 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Converted 112.00 MB image at 41.17 MB/s Jul 17 19:44:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0b0731a3-2ae1-4650-89e9-4c522d46c3a5 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:06 devstack sudo[95768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0b0731a3-2ae1-4650-89e9-4c522d46c3a5 1G Jul 17 19:44:06 devstack sudo[95768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:06 devstack sudo[95768]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0b0731a3-2ae1-4650-89e9-4c522d46c3a5 1G" returned: 0 in 0.603s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:06 devstack cinder-volume[87726]: DEBUG cinder.volume.volume_utils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Downloaded image 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'metadata': {}}])) to volume 0b0731a3-2ae1-4650-89e9-4c522d46c3a5 successfully. {{(pid=87726) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 19:44:06 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Temporary image 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 for user f1e28d03a4524051a0f2bdf474adbaf3 is deleted. {{(pid=87726) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 19:44:06 devstack cinder-volume[87726]: DEBUG cinder.volume.volume_utils [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Marking volume 0b0731a3-2ae1-4650-89e9-4c522d46c3a5 as bootable. {{(pid=87726) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 19:44:06 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Copying metadata from image 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 to 0b0731a3-2ae1-4650-89e9-4c522d46c3a5. {{(pid=87726) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 19:44:06 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Creating volume glance metadata for volume 0b0731a3-2ae1-4650-89e9-4c522d46c3a5 backed by image 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87726) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 19:44:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d450e4-108e-4422-8483-73d0d74bc892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b0731a3-2ae1-4650-89e9-4c522d46c3a5', 'volume_size': 1, 'image_id': '8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f9f36413d75c4b9e8be9b78b4ce9c162', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'created_at': datetime.datetime(2026, 7, 17, 17, 31, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 17, 31, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b702091e-6f07-48d9-8a43-7248bdb4b5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:07 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Volume volume-0b0731a3-2ae1-4650-89e9-4c522d46c3a5 (0b0731a3-2ae1-4650-89e9-4c522d46c3a5): created successfully Jul 17 19:44:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b702091e-6f07-48d9-8a43-7248bdb4b5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Flow 'volume_create_manager' (408e79ce-2319-4b87-a7f6-9955af97caaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:44:07 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-5bf678d5-ca6e-4ef6-9361-60fffed1b521 tempest-VolumesGetTest-1683131619 None] Created volume successfully. Jul 17 19:44:08 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:44:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] Flow 'volume_create_manager' (aca7a863-574f-40b6-ae8c-d7b91d3016b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:44:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13b973f5-305d-4028-8566-6a0f4ccf3ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13b973f5-305d-4028-8566-6a0f4ccf3ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:44:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1347069013',display_name='tempest-VolumesGetTest-Volume-782443892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f2f126-06b2-4196-9dd5-818476158a4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952812c7672047ec8b56b836145507ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:44:09Z,use_quota=True,user_id='f1e28d03a4524051a0f2bdf474adbaf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0f610c-532c-4bdb-afd4-0e5d2b9565ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0f610c-532c-4bdb-afd4-0e5d2b9565ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c54269-ecd3-4a10-ae2d-0bbfb54d848f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c54269-ecd3-4a10-ae2d-0bbfb54d848f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8f2f126-06b2-4196-9dd5-818476158a4e', 'volume_name': 'volume-c8f2f126-06b2-4196-9dd5-818476158a4e', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a44864f5-be8d-4159-b1ee-0bd908159c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a44864f5-be8d-4159-b1ee-0bd908159c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc67e93-ca0e-4175-bd45-bf9b510e2c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:09 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] Volume c8f2f126-06b2-4196-9dd5-818476158a4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8f2f126-06b2-4196-9dd5-818476158a4e', 'volume_size': 1} Jul 17 19:44:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:44:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1347069013',display_name='tempest-VolumesGetTest-Volume-782443892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f2f126-06b2-4196-9dd5-818476158a4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952812c7672047ec8b56b836145507ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:44:09Z,use_quota=True,user_id='f1e28d03a4524051a0f2bdf474adbaf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:44:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] Creating volume c8f2f126-06b2-4196-9dd5-818476158a4e {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:44:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:44:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:44:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:44:09 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:44:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c8f2f126-06b2-4196-9dd5-818476158a4e 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:09 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c8f2f126-06b2-4196-9dd5-818476158a4e 1073741824 Jul 17 19:44:09 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:09 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c8f2f126-06b2-4196-9dd5-818476158a4e 1073741824" returned: 0 in 0.540s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c8f2f126-06b2-4196-9dd5-818476158a4e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:09 devstack sudo[95784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c8f2f126-06b2-4196-9dd5-818476158a4e Jul 17 19:44:09 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c8f2f126-06b2-4196-9dd5-818476158a4e" returned: 0 in 0.284s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:44:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:09 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc67e93-ca0e-4175-bd45-bf9b510e2c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8f2f126-06b2-4196-9dd5-818476158a4e', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2afd6c45-b517-477b-8f37-81861b93f95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:10 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] Volume volume-c8f2f126-06b2-4196-9dd5-818476158a4e (c8f2f126-06b2-4196-9dd5-818476158a4e): created successfully Jul 17 19:44:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2afd6c45-b517-477b-8f37-81861b93f95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] Flow 'volume_create_manager' (aca7a863-574f-40b6-ae8c-d7b91d3016b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:44:10 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-8ce76f96-61ca-41da-9eae-c475dd6509a4 tempest-VolumesGetTest-1683131619 None] Created volume successfully. Jul 17 19:44:10 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:44:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] Flow 'volume_create_manager' (87fa9c32-2993-494d-b871-38818fd8e31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:44:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (442a53cf-ec82-484f-844f-afac0f766aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (442a53cf-ec82-484f-844f-afac0f766aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1119031809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63b3b4b7-fbd9-4ec1-af4c-78ea3dca9f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab82e6259dfe4ca4a31155929f92bb85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:44:10Z,use_quota=True,user_id='697c8081cc3f4dc49485b7498a5ee100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f2080c-7a5a-4f57-8489-f070f621ed81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f2080c-7a5a-4f57-8489-f070f621ed81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50266ac6-c4ec-4afe-b294-57e650e580f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50266ac6-c4ec-4afe-b294-57e650e580f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63b3b4b7-fbd9-4ec1-af4c-78ea3dca9f81', 'volume_name': 'volume-63b3b4b7-fbd9-4ec1-af4c-78ea3dca9f81', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59daab02-1c29-4590-8bd8-4587079062be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59daab02-1c29-4590-8bd8-4587079062be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7366e91e-f683-4b29-81be-84a0ddf244fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:10 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] Volume 63b3b4b7-fbd9-4ec1-af4c-78ea3dca9f81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63b3b4b7-fbd9-4ec1-af4c-78ea3dca9f81', 'volume_size': 1} Jul 17 19:44:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1119031809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63b3b4b7-fbd9-4ec1-af4c-78ea3dca9f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab82e6259dfe4ca4a31155929f92bb85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:44:10Z,use_quota=True,user_id='697c8081cc3f4dc49485b7498a5ee100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:44:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] Creating volume 63b3b4b7-fbd9-4ec1-af4c-78ea3dca9f81 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:44:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:44:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:44:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:44:10 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:44:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-63b3b4b7-fbd9-4ec1-af4c-78ea3dca9f81 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:10 devstack sudo[95787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-63b3b4b7-fbd9-4ec1-af4c-78ea3dca9f81 1073741824 Jul 17 19:44:10 devstack sudo[95787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:10 devstack sudo[95787]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-63b3b4b7-fbd9-4ec1-af4c-78ea3dca9f81 1073741824" returned: 0 in 0.443s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-63b3b4b7-fbd9-4ec1-af4c-78ea3dca9f81 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:10 devstack sudo[95793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-63b3b4b7-fbd9-4ec1-af4c-78ea3dca9f81 Jul 17 19:44:10 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:11 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-63b3b4b7-fbd9-4ec1-af4c-78ea3dca9f81" returned: 0 in 0.272s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:44:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7366e91e-f683-4b29-81be-84a0ddf244fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63b3b4b7-fbd9-4ec1-af4c-78ea3dca9f81', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09dbd14c-8967-4e84-b550-ed96ab2db642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:11 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] Volume volume-63b3b4b7-fbd9-4ec1-af4c-78ea3dca9f81 (63b3b4b7-fbd9-4ec1-af4c-78ea3dca9f81): created successfully Jul 17 19:44:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09dbd14c-8967-4e84-b550-ed96ab2db642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] Flow 'volume_create_manager' (87fa9c32-2993-494d-b871-38818fd8e31b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:44:11 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-9f539f42-21f9-4025-a618-505303db9a24 tempest-AttachVolumeNegativeTest-1875054094 None] Created volume successfully. Jul 17 19:44:11 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-97c7c28f-dba8-480c-b6ac-c2d1d4a8a3cc tempest-VolumesGetTest-1683131619 None] Acquiring lock "cinder-c8f2f126-06b2-4196-9dd5-818476158a4e-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:44:11 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-97c7c28f-dba8-480c-b6ac-c2d1d4a8a3cc tempest-VolumesGetTest-1683131619 None] Lock "cinder-c8f2f126-06b2-4196-9dd5-818476158a4e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:44:11 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-97c7c28f-dba8-480c-b6ac-c2d1d4a8a3cc tempest-VolumesGetTest-1683131619 None] Acquiring lock "cinder-quobyte-c8f2f126-06b2-4196-9dd5-818476158a4e" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:44:11 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-97c7c28f-dba8-480c-b6ac-c2d1d4a8a3cc tempest-VolumesGetTest-1683131619 None] Lock "cinder-quobyte-c8f2f126-06b2-4196-9dd5-818476158a4e" acquired by "delete_volume" :: waited 0.031s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:44:11 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc64763-997d-4a5f-aea9-6d9e64a54ff2]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:44:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-97c7c28f-dba8-480c-b6ac-c2d1d4a8a3cc tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c8f2f126-06b2-4196-9dd5-818476158a4e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:11 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c8f2f126-06b2-4196-9dd5-818476158a4e Jul 17 19:44:11 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:11 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-97c7c28f-dba8-480c-b6ac-c2d1d4a8a3cc tempest-VolumesGetTest-1683131619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c8f2f126-06b2-4196-9dd5-818476158a4e" returned: 0 in 0.466s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-97c7c28f-dba8-480c-b6ac-c2d1d4a8a3cc tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c8f2f126-06b2-4196-9dd5-818476158a4e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:11 devstack sudo[95806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c8f2f126-06b2-4196-9dd5-818476158a4e Jul 17 19:44:11 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:12 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-97c7c28f-dba8-480c-b6ac-c2d1d4a8a3cc tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c8f2f126-06b2-4196-9dd5-818476158a4e" returned: 0 in 0.322s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:12 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-97c7c28f-dba8-480c-b6ac-c2d1d4a8a3cc tempest-VolumesGetTest-1683131619 None] Lock "cinder-quobyte-c8f2f126-06b2-4196-9dd5-818476158a4e" released by "delete_volume" :: held 0.856s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:44:12 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-97c7c28f-dba8-480c-b6ac-c2d1d4a8a3cc tempest-VolumesGetTest-1683131619 None] Created reservations ['6c184484-1d11-4252-b155-d1432671e5a1', '44aaf939-cfa3-4400-a3f2-b633c218beaf', '8f0912e6-ec4a-4c0c-b6a4-094bd2a7a461', '8c337962-0af0-45c5-9f5e-b748b5063297'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:44:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-6e4796d9-d572-430f-b63f-d43f55ac16e4 req-03912f1f-dc70-41e0-a575-c2cb544c5029 tempest-AttachVolumeNegativeTest-1875054094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-6e4796d9-d572-430f-b63f-d43f55ac16e4 req-03912f1f-dc70-41e0-a575-c2cb544c5029 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-6e4796d9-d572-430f-b63f-d43f55ac16e4 req-03912f1f-dc70-41e0-a575-c2cb544c5029 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-6e4796d9-d572-430f-b63f-d43f55ac16e4 req-03912f1f-dc70-41e0-a575-c2cb544c5029 tempest-AttachVolumeNegativeTest-1875054094 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55', 'name': 'volume-63b3b4b7-fbd9-4ec1-af4c-78ea3dca9f81', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b54229f9-4ca3-4d9c-bd6e-168cd5b61061', 'enforce_multipath': True} {{(pid=87726) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 19:44:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-97c7c28f-dba8-480c-b6ac-c2d1d4a8a3cc tempest-VolumesGetTest-1683131619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-97c7c28f-dba8-480c-b6ac-c2d1d4a8a3cc tempest-VolumesGetTest-1683131619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-97c7c28f-dba8-480c-b6ac-c2d1d4a8a3cc tempest-VolumesGetTest-1683131619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:44:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-97c7c28f-dba8-480c-b6ac-c2d1d4a8a3cc tempest-VolumesGetTest-1683131619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:44:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-97c7c28f-dba8-480c-b6ac-c2d1d4a8a3cc tempest-VolumesGetTest-1683131619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-97c7c28f-dba8-480c-b6ac-c2d1d4a8a3cc tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:12 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:44:12 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:12 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-6e4796d9-d572-430f-b63f-d43f55ac16e4 req-03912f1f-dc70-41e0-a575-c2cb544c5029 tempest-AttachVolumeNegativeTest-1875054094 None] attachment_update completed successfully. Jul 17 19:44:12 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7af2cd9b-91ff-4680-95cd-9b5c15322a02 tempest-VolumesGetTest-1683131619 None] Acquiring lock "cinder-0b0731a3-2ae1-4650-89e9-4c522d46c3a5-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:44:12 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7af2cd9b-91ff-4680-95cd-9b5c15322a02 tempest-VolumesGetTest-1683131619 None] Lock "cinder-0b0731a3-2ae1-4650-89e9-4c522d46c3a5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:44:12 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7af2cd9b-91ff-4680-95cd-9b5c15322a02 tempest-VolumesGetTest-1683131619 None] Acquiring lock "cinder-quobyte-0b0731a3-2ae1-4650-89e9-4c522d46c3a5" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:44:12 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7af2cd9b-91ff-4680-95cd-9b5c15322a02 tempest-VolumesGetTest-1683131619 None] Lock "cinder-quobyte-0b0731a3-2ae1-4650-89e9-4c522d46c3a5" acquired by "delete_volume" :: waited 0.026s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:44:12 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acb7198-cb37-4b60-b090-d585bf8e84af]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:44:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7af2cd9b-91ff-4680-95cd-9b5c15322a02 tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0b0731a3-2ae1-4650-89e9-4c522d46c3a5 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:12 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-97c7c28f-dba8-480c-b6ac-c2d1d4a8a3cc tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.553s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:12 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-97c7c28f-dba8-480c-b6ac-c2d1d4a8a3cc tempest-VolumesGetTest-1683131619 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:44:12 devstack sudo[95846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0b0731a3-2ae1-4650-89e9-4c522d46c3a5 Jul 17 19:44:12 devstack sudo[95846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:12 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-97c7c28f-dba8-480c-b6ac-c2d1d4a8a3cc tempest-VolumesGetTest-1683131619 None] Deleted volume successfully. Jul 17 19:44:12 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-97c7c28f-dba8-480c-b6ac-c2d1d4a8a3cc tempest-VolumesGetTest-1683131619 None] Lock "cinder-c8f2f126-06b2-4196-9dd5-818476158a4e-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:44:13 devstack sudo[95846]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7af2cd9b-91ff-4680-95cd-9b5c15322a02 tempest-VolumesGetTest-1683131619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0b0731a3-2ae1-4650-89e9-4c522d46c3a5" returned: 0 in 0.639s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7af2cd9b-91ff-4680-95cd-9b5c15322a02 tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0b0731a3-2ae1-4650-89e9-4c522d46c3a5 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:13 devstack sudo[96225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0b0731a3-2ae1-4650-89e9-4c522d46c3a5 Jul 17 19:44:13 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:13 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7af2cd9b-91ff-4680-95cd-9b5c15322a02 tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-0b0731a3-2ae1-4650-89e9-4c522d46c3a5" returned: 0 in 0.279s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7af2cd9b-91ff-4680-95cd-9b5c15322a02 tempest-VolumesGetTest-1683131619 None] Lock "cinder-quobyte-0b0731a3-2ae1-4650-89e9-4c522d46c3a5" released by "delete_volume" :: held 0.998s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:44:13 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-7af2cd9b-91ff-4680-95cd-9b5c15322a02 tempest-VolumesGetTest-1683131619 None] Created reservations ['639b7d0e-adbe-4a61-948e-03d31ce5c53f', '6a2b09f8-8c8c-40cd-af7d-9eb8b3e22359', '0e48d34d-43b0-4235-9e60-e308ace0e467', '680f3a9f-29d0-4439-a660-0719f10585b5'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:44:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7af2cd9b-91ff-4680-95cd-9b5c15322a02 tempest-VolumesGetTest-1683131619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7af2cd9b-91ff-4680-95cd-9b5c15322a02 tempest-VolumesGetTest-1683131619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:13 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7af2cd9b-91ff-4680-95cd-9b5c15322a02 tempest-VolumesGetTest-1683131619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:44:13 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7af2cd9b-91ff-4680-95cd-9b5c15322a02 tempest-VolumesGetTest-1683131619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:44:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7af2cd9b-91ff-4680-95cd-9b5c15322a02 tempest-VolumesGetTest-1683131619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7af2cd9b-91ff-4680-95cd-9b5c15322a02 tempest-VolumesGetTest-1683131619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:13 devstack sudo[96228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:44:13 devstack sudo[96228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:14 devstack sudo[96228]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7af2cd9b-91ff-4680-95cd-9b5c15322a02 tempest-VolumesGetTest-1683131619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.277s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:14 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-7af2cd9b-91ff-4680-95cd-9b5c15322a02 tempest-VolumesGetTest-1683131619 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:44:14 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-7af2cd9b-91ff-4680-95cd-9b5c15322a02 tempest-VolumesGetTest-1683131619 None] Deleted volume successfully. Jul 17 19:44:14 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7af2cd9b-91ff-4680-95cd-9b5c15322a02 tempest-VolumesGetTest-1683131619 None] Lock "cinder-0b0731a3-2ae1-4650-89e9-4c522d46c3a5-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:44:15 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-f1156eb4-a27d-4994-8ded-84e8b3cf8b74 req-2cde69c3-09fb-441e-92fb-e114da92ee57 tempest-AttachVolumeNegativeTest-1875054094 None] Terminate volume connection completed successfully. Jul 17 19:44:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-f1156eb4-a27d-4994-8ded-84e8b3cf8b74 req-2cde69c3-09fb-441e-92fb-e114da92ee57 tempest-AttachVolumeNegativeTest-1875054094 None] Deleting attachment b54229f9-4ca3-4d9c-bd6e-168cd5b61061. {{(pid=87726) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 19:44:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:44:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:44:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:44:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:15 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:44:15 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:15 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.310s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:15 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:44:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager._thread_info {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:44:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread count: 28 {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 19:44:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread info: [<_MainThread(MainThread, started 130066227544192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 19:44:18 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:44:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] Flow 'volume_create_manager' (2aa3991a-c90e-4a23-a140-728942c61565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:44:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (464183a6-dd51-496a-acc2-8bc5d20f6301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (464183a6-dd51-496a-acc2-8bc5d20f6301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1205386939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc9e121-b34b-4707-a9f9-e9a7ce9c8e7f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='52e5aa87b78d4c3494ecb7b08c7fb77f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:44:19Z,use_quota=True,user_id='9af65921292f4266ab02a5a5b723a39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21f2ce88-3b6d-4147-aebf-28136daf42f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21f2ce88-3b6d-4147-aebf-28136daf42f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c3b213-5d2a-4850-aa6b-129d2e648bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c3b213-5d2a-4850-aa6b-129d2e648bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbc9e121-b34b-4707-a9f9-e9a7ce9c8e7f', 'volume_name': 'volume-dbc9e121-b34b-4707-a9f9-e9a7ce9c8e7f', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d0413e2-5eaf-43de-b4ad-58afc9b3d2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d0413e2-5eaf-43de-b4ad-58afc9b3d2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb2062e-940e-435c-852e-7e127e85a4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:18 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] Volume dbc9e121-b34b-4707-a9f9-e9a7ce9c8e7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbc9e121-b34b-4707-a9f9-e9a7ce9c8e7f', 'volume_size': 1} Jul 17 19:44:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:18 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1205386939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc9e121-b34b-4707-a9f9-e9a7ce9c8e7f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='52e5aa87b78d4c3494ecb7b08c7fb77f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:44:19Z,use_quota=True,user_id='9af65921292f4266ab02a5a5b723a39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:44:18 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] Creating volume dbc9e121-b34b-4707-a9f9-e9a7ce9c8e7f {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:44:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:18 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:44:18 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:44:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:18 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:44:18 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:44:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-dbc9e121-b34b-4707-a9f9-e9a7ce9c8e7f 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:18 devstack sudo[96299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-dbc9e121-b34b-4707-a9f9-e9a7ce9c8e7f 1073741824 Jul 17 19:44:18 devstack sudo[96299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:19 devstack sudo[96299]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-dbc9e121-b34b-4707-a9f9-e9a7ce9c8e7f 1073741824" returned: 0 in 0.501s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-dbc9e121-b34b-4707-a9f9-e9a7ce9c8e7f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:19 devstack sudo[96305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-dbc9e121-b34b-4707-a9f9-e9a7ce9c8e7f Jul 17 19:44:19 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:19 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-dbc9e121-b34b-4707-a9f9-e9a7ce9c8e7f" returned: 0 in 0.281s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:19 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:44:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb2062e-940e-435c-852e-7e127e85a4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbc9e121-b34b-4707-a9f9-e9a7ce9c8e7f', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef7f91ee-4809-45e7-b378-e8743e768d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:19 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] Volume volume-dbc9e121-b34b-4707-a9f9-e9a7ce9c8e7f (dbc9e121-b34b-4707-a9f9-e9a7ce9c8e7f): created successfully Jul 17 19:44:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef7f91ee-4809-45e7-b378-e8743e768d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] Flow 'volume_create_manager' (2aa3991a-c90e-4a23-a140-728942c61565) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:44:19 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-4e8487a2-7b82-4221-b662-0fbe34d3ca78 tempest-VolumesListTestJSON-920956369 None] Created volume successfully. Jul 17 19:44:21 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:44:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] Flow 'volume_create_manager' (39151723-c8d3-4e91-9c6c-5a0197701e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:44:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a691ee-0eb2-4cb0-912a-ae35a1645532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a691ee-0eb2-4cb0-912a-ae35a1645532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-778647553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e13a1a3d-2bb7-44d0-a14c-2a7dad631843,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='52e5aa87b78d4c3494ecb7b08c7fb77f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:44:21Z,use_quota=True,user_id='9af65921292f4266ab02a5a5b723a39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e564e5-0ff2-4db5-b636-2f7db5c6056c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e564e5-0ff2-4db5-b636-2f7db5c6056c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a250bef-eac8-440a-813d-d5997617a322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a250bef-eac8-440a-813d-d5997617a322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e13a1a3d-2bb7-44d0-a14c-2a7dad631843', 'volume_name': 'volume-e13a1a3d-2bb7-44d0-a14c-2a7dad631843', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (730f2e6b-e68e-4e0a-8afe-339603632c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (730f2e6b-e68e-4e0a-8afe-339603632c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef048662-f477-4208-86df-753a03b69c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:21 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] Volume e13a1a3d-2bb7-44d0-a14c-2a7dad631843: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e13a1a3d-2bb7-44d0-a14c-2a7dad631843', 'volume_size': 1} Jul 17 19:44:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-778647553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e13a1a3d-2bb7-44d0-a14c-2a7dad631843,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='52e5aa87b78d4c3494ecb7b08c7fb77f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:44:21Z,use_quota=True,user_id='9af65921292f4266ab02a5a5b723a39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:44:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] Creating volume e13a1a3d-2bb7-44d0-a14c-2a7dad631843 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:44:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:44:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:44:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:44:21 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:44:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-e13a1a3d-2bb7-44d0-a14c-2a7dad631843 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:21 devstack sudo[96309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-e13a1a3d-2bb7-44d0-a14c-2a7dad631843 1073741824 Jul 17 19:44:21 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:21 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-e13a1a3d-2bb7-44d0-a14c-2a7dad631843 1073741824" returned: 0 in 0.443s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-e13a1a3d-2bb7-44d0-a14c-2a7dad631843 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:21 devstack sudo[96315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-e13a1a3d-2bb7-44d0-a14c-2a7dad631843 Jul 17 19:44:21 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:22 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-e13a1a3d-2bb7-44d0-a14c-2a7dad631843" returned: 0 in 0.253s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:44:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef048662-f477-4208-86df-753a03b69c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e13a1a3d-2bb7-44d0-a14c-2a7dad631843', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e77bbb-53e3-457b-9132-c91c9d207ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:22 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] Volume volume-e13a1a3d-2bb7-44d0-a14c-2a7dad631843 (e13a1a3d-2bb7-44d0-a14c-2a7dad631843): created successfully Jul 17 19:44:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e77bbb-53e3-457b-9132-c91c9d207ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] Flow 'volume_create_manager' (39151723-c8d3-4e91-9c6c-5a0197701e61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:44:22 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-b25d5c3b-e321-4188-b069-aef36f58702a tempest-VolumesListTestJSON-920956369 None] Created volume successfully. Jul 17 19:44:22 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:44:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] Flow 'volume_create_manager' (a1708ddd-be53-4e0d-b3c6-03d987eecf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:44:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf4b5685-15cc-4c88-b1f7-7a925a273a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf4b5685-15cc-4c88-b1f7-7a925a273a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2006201485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9c9d296-e55c-40c8-a583-1fef0b9b8c5b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='52e5aa87b78d4c3494ecb7b08c7fb77f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:44:23Z,use_quota=True,user_id='9af65921292f4266ab02a5a5b723a39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5950f217-fdcc-48ee-adf2-62743557dfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5950f217-fdcc-48ee-adf2-62743557dfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3987eeb8-4248-46c5-94bb-b05bd9e2dc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3987eeb8-4248-46c5-94bb-b05bd9e2dc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9c9d296-e55c-40c8-a583-1fef0b9b8c5b', 'volume_name': 'volume-c9c9d296-e55c-40c8-a583-1fef0b9b8c5b', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c210df5a-cb05-4f7c-851f-000d822d2c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c210df5a-cb05-4f7c-851f-000d822d2c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da26db6d-1cee-46f3-92ef-e13175923731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:22 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] Volume c9c9d296-e55c-40c8-a583-1fef0b9b8c5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9c9d296-e55c-40c8-a583-1fef0b9b8c5b', 'volume_size': 1} Jul 17 19:44:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2006201485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9c9d296-e55c-40c8-a583-1fef0b9b8c5b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='52e5aa87b78d4c3494ecb7b08c7fb77f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:44:23Z,use_quota=True,user_id='9af65921292f4266ab02a5a5b723a39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:44:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] Creating volume c9c9d296-e55c-40c8-a583-1fef0b9b8c5b {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:44:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:44:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:44:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:44:22 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:44:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9c9d296-e55c-40c8-a583-1fef0b9b8c5b 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:22 devstack sudo[96321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9c9d296-e55c-40c8-a583-1fef0b9b8c5b 1073741824 Jul 17 19:44:22 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:23 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9c9d296-e55c-40c8-a583-1fef0b9b8c5b 1073741824" returned: 0 in 0.505s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9c9d296-e55c-40c8-a583-1fef0b9b8c5b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:23 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9c9d296-e55c-40c8-a583-1fef0b9b8c5b Jul 17 19:44:23 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:23 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9c9d296-e55c-40c8-a583-1fef0b9b8c5b" returned: 0 in 0.308s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:44:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da26db6d-1cee-46f3-92ef-e13175923731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9c9d296-e55c-40c8-a583-1fef0b9b8c5b', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (692ece15-246d-43fb-84f2-02d79ddc173b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:23 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] Volume volume-c9c9d296-e55c-40c8-a583-1fef0b9b8c5b (c9c9d296-e55c-40c8-a583-1fef0b9b8c5b): created successfully Jul 17 19:44:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (692ece15-246d-43fb-84f2-02d79ddc173b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] Flow 'volume_create_manager' (a1708ddd-be53-4e0d-b3c6-03d987eecf56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:44:23 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-4ea35ae6-75da-468d-bb15-fd80efa2810a tempest-VolumesListTestJSON-920956369 None] Created volume successfully. Jul 17 19:44:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a73ef7fa-c44c-4efc-a23c-f7da43825a83 tempest-VolumesListTestJSON-920956369 None] Acquiring lock "cinder-c9c9d296-e55c-40c8-a583-1fef0b9b8c5b-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:44:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a73ef7fa-c44c-4efc-a23c-f7da43825a83 tempest-VolumesListTestJSON-920956369 None] Lock "cinder-c9c9d296-e55c-40c8-a583-1fef0b9b8c5b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:44:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a73ef7fa-c44c-4efc-a23c-f7da43825a83 tempest-VolumesListTestJSON-920956369 None] Acquiring lock "cinder-quobyte-c9c9d296-e55c-40c8-a583-1fef0b9b8c5b" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:44:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a73ef7fa-c44c-4efc-a23c-f7da43825a83 tempest-VolumesListTestJSON-920956369 None] Lock "cinder-quobyte-c9c9d296-e55c-40c8-a583-1fef0b9b8c5b" acquired by "delete_volume" :: waited 0.047s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:44:28 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e66201-7bf5-4df6-bafb-57b21d651a43]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:44:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a73ef7fa-c44c-4efc-a23c-f7da43825a83 tempest-VolumesListTestJSON-920956369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9c9d296-e55c-40c8-a583-1fef0b9b8c5b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:28 devstack sudo[96412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9c9d296-e55c-40c8-a583-1fef0b9b8c5b Jul 17 19:44:28 devstack sudo[96412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:28 devstack sudo[96412]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a73ef7fa-c44c-4efc-a23c-f7da43825a83 tempest-VolumesListTestJSON-920956369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9c9d296-e55c-40c8-a583-1fef0b9b8c5b" returned: 0 in 0.711s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a73ef7fa-c44c-4efc-a23c-f7da43825a83 tempest-VolumesListTestJSON-920956369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9c9d296-e55c-40c8-a583-1fef0b9b8c5b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:29 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9c9d296-e55c-40c8-a583-1fef0b9b8c5b Jul 17 19:44:29 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:29 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a73ef7fa-c44c-4efc-a23c-f7da43825a83 tempest-VolumesListTestJSON-920956369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9c9d296-e55c-40c8-a583-1fef0b9b8c5b" returned: 0 in 0.502s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a73ef7fa-c44c-4efc-a23c-f7da43825a83 tempest-VolumesListTestJSON-920956369 None] Lock "cinder-quobyte-c9c9d296-e55c-40c8-a583-1fef0b9b8c5b" released by "delete_volume" :: held 1.305s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:44:29 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-a73ef7fa-c44c-4efc-a23c-f7da43825a83 tempest-VolumesListTestJSON-920956369 None] Created reservations ['01ca656f-2163-45d2-8ae9-87e69422ccfe', '9ba48c71-155a-40af-9b2e-95fcb45c2786', '658d044e-8fcb-405e-ac8b-02303382276e', '86d26a12-02af-4045-af62-fd316eea389d'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:44:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a73ef7fa-c44c-4efc-a23c-f7da43825a83 tempest-VolumesListTestJSON-920956369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a73ef7fa-c44c-4efc-a23c-f7da43825a83 tempest-VolumesListTestJSON-920956369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:29 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a73ef7fa-c44c-4efc-a23c-f7da43825a83 tempest-VolumesListTestJSON-920956369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:44:29 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a73ef7fa-c44c-4efc-a23c-f7da43825a83 tempest-VolumesListTestJSON-920956369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:44:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a73ef7fa-c44c-4efc-a23c-f7da43825a83 tempest-VolumesListTestJSON-920956369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a73ef7fa-c44c-4efc-a23c-f7da43825a83 tempest-VolumesListTestJSON-920956369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:29 devstack sudo[96426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:44:29 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:29 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a73ef7fa-c44c-4efc-a23c-f7da43825a83 tempest-VolumesListTestJSON-920956369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.340s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:29 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-a73ef7fa-c44c-4efc-a23c-f7da43825a83 tempest-VolumesListTestJSON-920956369 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:44:29 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-a73ef7fa-c44c-4efc-a23c-f7da43825a83 tempest-VolumesListTestJSON-920956369 None] Deleted volume successfully. Jul 17 19:44:30 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a73ef7fa-c44c-4efc-a23c-f7da43825a83 tempest-VolumesListTestJSON-920956369 None] Lock "cinder-c9c9d296-e55c-40c8-a583-1fef0b9b8c5b-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:44:30 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0974116a-5415-4c99-957b-347e1a38f9dc tempest-VolumesListTestJSON-920956369 None] Acquiring lock "cinder-e13a1a3d-2bb7-44d0-a14c-2a7dad631843-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:44:30 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0974116a-5415-4c99-957b-347e1a38f9dc tempest-VolumesListTestJSON-920956369 None] Lock "cinder-e13a1a3d-2bb7-44d0-a14c-2a7dad631843-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:44:30 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0974116a-5415-4c99-957b-347e1a38f9dc tempest-VolumesListTestJSON-920956369 None] Acquiring lock "cinder-quobyte-e13a1a3d-2bb7-44d0-a14c-2a7dad631843" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:44:30 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0974116a-5415-4c99-957b-347e1a38f9dc tempest-VolumesListTestJSON-920956369 None] Lock "cinder-quobyte-e13a1a3d-2bb7-44d0-a14c-2a7dad631843" acquired by "delete_volume" :: waited 0.032s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:44:30 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc5a3c1-f78e-4a1b-83c8-74d6e5e92521]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:44:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0974116a-5415-4c99-957b-347e1a38f9dc tempest-VolumesListTestJSON-920956369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-e13a1a3d-2bb7-44d0-a14c-2a7dad631843 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:30 devstack sudo[96432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-e13a1a3d-2bb7-44d0-a14c-2a7dad631843 Jul 17 19:44:30 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:31 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:44:31 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] Flow 'volume_create_manager' (e2cb2aba-dc63-4ee7-b12a-6cdf4461fe26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:44:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302c7d62-90b9-48f6-b3e6-f48583587a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0974116a-5415-4c99-957b-347e1a38f9dc tempest-VolumesListTestJSON-920956369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-e13a1a3d-2bb7-44d0-a14c-2a7dad631843" returned: 0 in 0.598s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0974116a-5415-4c99-957b-347e1a38f9dc tempest-VolumesListTestJSON-920956369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-e13a1a3d-2bb7-44d0-a14c-2a7dad631843 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302c7d62-90b9-48f6-b3e6-f48583587a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1807629781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84b3af6f-2b3b-4472-9ad8-5b21a713e87a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdda1a0eaf1540d6871d8eea61b6a0e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:44:31Z,use_quota=True,user_id='e63aafdffa894a16b4a4b00866aba5e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d073500-582d-452b-bb95-15e0450f6408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:31 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-e13a1a3d-2bb7-44d0-a14c-2a7dad631843 Jul 17 19:44:31 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d073500-582d-452b-bb95-15e0450f6408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (219bcaf9-a43f-4557-af31-25ae6f2ea155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (219bcaf9-a43f-4557-af31-25ae6f2ea155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84b3af6f-2b3b-4472-9ad8-5b21a713e87a', 'volume_name': 'volume-84b3af6f-2b3b-4472-9ad8-5b21a713e87a', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ae6fc7-c005-4805-bd62-7b2e2d54a4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ae6fc7-c005-4805-bd62-7b2e2d54a4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c39168cf-56d0-484f-962b-f71ccd02cab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:31 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] Volume 84b3af6f-2b3b-4472-9ad8-5b21a713e87a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84b3af6f-2b3b-4472-9ad8-5b21a713e87a', 'volume_size': 1} Jul 17 19:44:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1807629781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84b3af6f-2b3b-4472-9ad8-5b21a713e87a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdda1a0eaf1540d6871d8eea61b6a0e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:44:31Z,use_quota=True,user_id='e63aafdffa894a16b4a4b00866aba5e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:44:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] Creating volume 84b3af6f-2b3b-4472-9ad8-5b21a713e87a {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:44:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:44:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:44:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:44:31 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:44:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84b3af6f-2b3b-4472-9ad8-5b21a713e87a 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:31 devstack sudo[96440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84b3af6f-2b3b-4472-9ad8-5b21a713e87a 1073741824 Jul 17 19:44:31 devstack sudo[96440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:31 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0974116a-5415-4c99-957b-347e1a38f9dc tempest-VolumesListTestJSON-920956369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-e13a1a3d-2bb7-44d0-a14c-2a7dad631843" returned: 0 in 0.399s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:31 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0974116a-5415-4c99-957b-347e1a38f9dc tempest-VolumesListTestJSON-920956369 None] Lock "cinder-quobyte-e13a1a3d-2bb7-44d0-a14c-2a7dad631843" released by "delete_volume" :: held 1.071s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:44:31 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-0974116a-5415-4c99-957b-347e1a38f9dc tempest-VolumesListTestJSON-920956369 None] Created reservations ['9b609776-8919-464b-b496-393aa9ae27fa', 'c6fe416a-625e-476f-a88f-3d09d5754e48', '98101b39-97c8-4dbc-8dd3-868e38ae2a95', 'e5cd1916-b956-4efd-9ec4-9f97e330bce9'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:44:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0974116a-5415-4c99-957b-347e1a38f9dc tempest-VolumesListTestJSON-920956369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0974116a-5415-4c99-957b-347e1a38f9dc tempest-VolumesListTestJSON-920956369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:32 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0974116a-5415-4c99-957b-347e1a38f9dc tempest-VolumesListTestJSON-920956369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:44:32 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0974116a-5415-4c99-957b-347e1a38f9dc tempest-VolumesListTestJSON-920956369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:44:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0974116a-5415-4c99-957b-347e1a38f9dc tempest-VolumesListTestJSON-920956369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0974116a-5415-4c99-957b-347e1a38f9dc tempest-VolumesListTestJSON-920956369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:32 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:44:32 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:32 devstack sudo[96440]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84b3af6f-2b3b-4472-9ad8-5b21a713e87a 1073741824" returned: 0 in 0.704s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84b3af6f-2b3b-4472-9ad8-5b21a713e87a {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:32 devstack sudo[96449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84b3af6f-2b3b-4472-9ad8-5b21a713e87a Jul 17 19:44:32 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:32 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0974116a-5415-4c99-957b-347e1a38f9dc tempest-VolumesListTestJSON-920956369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.342s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:32 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-0974116a-5415-4c99-957b-347e1a38f9dc tempest-VolumesListTestJSON-920956369 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:44:32 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-0974116a-5415-4c99-957b-347e1a38f9dc tempest-VolumesListTestJSON-920956369 None] Deleted volume successfully. Jul 17 19:44:32 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0974116a-5415-4c99-957b-347e1a38f9dc tempest-VolumesListTestJSON-920956369 None] Lock "cinder-e13a1a3d-2bb7-44d0-a14c-2a7dad631843-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:44:32 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84b3af6f-2b3b-4472-9ad8-5b21a713e87a" returned: 0 in 0.303s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:32 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:44:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c39168cf-56d0-484f-962b-f71ccd02cab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84b3af6f-2b3b-4472-9ad8-5b21a713e87a', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec2067d2-e218-400c-bafd-b5cb15aefc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:32 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] Volume volume-84b3af6f-2b3b-4472-9ad8-5b21a713e87a (84b3af6f-2b3b-4472-9ad8-5b21a713e87a): created successfully Jul 17 19:44:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec2067d2-e218-400c-bafd-b5cb15aefc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] Flow 'volume_create_manager' (e2cb2aba-dc63-4ee7-b12a-6cdf4461fe26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:44:32 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-322002e7-bb8f-4a0e-ac35-f8b0e357680a tempest-AttachVolumeTestJSON-1460626915 None] Created volume successfully. Jul 17 19:44:33 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e109d485-91d9-4e47-96dd-d1252c864d03 tempest-VolumesListTestJSON-920956369 None] Acquiring lock "cinder-dbc9e121-b34b-4707-a9f9-e9a7ce9c8e7f-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:44:33 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e109d485-91d9-4e47-96dd-d1252c864d03 tempest-VolumesListTestJSON-920956369 None] Lock "cinder-dbc9e121-b34b-4707-a9f9-e9a7ce9c8e7f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:44:33 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e109d485-91d9-4e47-96dd-d1252c864d03 tempest-VolumesListTestJSON-920956369 None] Acquiring lock "cinder-quobyte-dbc9e121-b34b-4707-a9f9-e9a7ce9c8e7f" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:44:33 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e109d485-91d9-4e47-96dd-d1252c864d03 tempest-VolumesListTestJSON-920956369 None] Lock "cinder-quobyte-dbc9e121-b34b-4707-a9f9-e9a7ce9c8e7f" acquired by "delete_volume" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:44:33 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bf68f0-6fe4-4538-af4c-57e3e5dfb853]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:44:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e109d485-91d9-4e47-96dd-d1252c864d03 tempest-VolumesListTestJSON-920956369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-dbc9e121-b34b-4707-a9f9-e9a7ce9c8e7f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:33 devstack sudo[96454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-dbc9e121-b34b-4707-a9f9-e9a7ce9c8e7f Jul 17 19:44:33 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:33 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e109d485-91d9-4e47-96dd-d1252c864d03 tempest-VolumesListTestJSON-920956369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-dbc9e121-b34b-4707-a9f9-e9a7ce9c8e7f" returned: 0 in 0.406s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e109d485-91d9-4e47-96dd-d1252c864d03 tempest-VolumesListTestJSON-920956369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-dbc9e121-b34b-4707-a9f9-e9a7ce9c8e7f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:33 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-dbc9e121-b34b-4707-a9f9-e9a7ce9c8e7f Jul 17 19:44:33 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:33 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e109d485-91d9-4e47-96dd-d1252c864d03 tempest-VolumesListTestJSON-920956369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-dbc9e121-b34b-4707-a9f9-e9a7ce9c8e7f" returned: 0 in 0.327s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:33 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e109d485-91d9-4e47-96dd-d1252c864d03 tempest-VolumesListTestJSON-920956369 None] Lock "cinder-quobyte-dbc9e121-b34b-4707-a9f9-e9a7ce9c8e7f" released by "delete_volume" :: held 0.779s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:44:33 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-e109d485-91d9-4e47-96dd-d1252c864d03 tempest-VolumesListTestJSON-920956369 None] Created reservations ['ac1ba6e6-eeba-4c93-94ed-80ad0d493d2f', 'b7972194-3491-493a-99a4-8344bce084a8', '718e8d8e-6dbf-4348-959d-fd55c46182a0', '15451762-09d2-47d9-b149-2f5fdb334028'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:44:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e109d485-91d9-4e47-96dd-d1252c864d03 tempest-VolumesListTestJSON-920956369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e109d485-91d9-4e47-96dd-d1252c864d03 tempest-VolumesListTestJSON-920956369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:34 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e109d485-91d9-4e47-96dd-d1252c864d03 tempest-VolumesListTestJSON-920956369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:44:34 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e109d485-91d9-4e47-96dd-d1252c864d03 tempest-VolumesListTestJSON-920956369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:44:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e109d485-91d9-4e47-96dd-d1252c864d03 tempest-VolumesListTestJSON-920956369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e109d485-91d9-4e47-96dd-d1252c864d03 tempest-VolumesListTestJSON-920956369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:34 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:44:34 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-b6b68c47-de61-487f-b865-7cf317e37cd8 req-266a102c-5684-4227-b6f2-4c6d9ad7ec3b tempest-AttachVolumeTestJSON-1460626915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-b6b68c47-de61-487f-b865-7cf317e37cd8 req-266a102c-5684-4227-b6f2-4c6d9ad7ec3b tempest-AttachVolumeTestJSON-1460626915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-b6b68c47-de61-487f-b865-7cf317e37cd8 req-266a102c-5684-4227-b6f2-4c6d9ad7ec3b tempest-AttachVolumeTestJSON-1460626915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:34 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e109d485-91d9-4e47-96dd-d1252c864d03 tempest-VolumesListTestJSON-920956369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.353s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:34 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-e109d485-91d9-4e47-96dd-d1252c864d03 tempest-VolumesListTestJSON-920956369 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:44:34 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e109d485-91d9-4e47-96dd-d1252c864d03 tempest-VolumesListTestJSON-920956369 None] Deleted volume successfully. Jul 17 19:44:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-b6b68c47-de61-487f-b865-7cf317e37cd8 req-266a102c-5684-4227-b6f2-4c6d9ad7ec3b tempest-AttachVolumeTestJSON-1460626915 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55', 'name': 'volume-84b3af6f-2b3b-4472-9ad8-5b21a713e87a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '938d3c1e-9406-48fa-9fef-2795c89f8723', 'enforce_multipath': True} {{(pid=87726) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 19:44:34 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e109d485-91d9-4e47-96dd-d1252c864d03 tempest-VolumesListTestJSON-920956369 None] Lock "cinder-dbc9e121-b34b-4707-a9f9-e9a7ce9c8e7f-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:44:34 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-b6b68c47-de61-487f-b865-7cf317e37cd8 req-266a102c-5684-4227-b6f2-4c6d9ad7ec3b tempest-AttachVolumeTestJSON-1460626915 None] attachment_update completed successfully. Jul 17 19:44:37 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:44:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] Flow 'volume_create_manager' (2782edeb-e3d8-4b31-96d9-bb79657b5220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:44:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75ec4764-6861-489f-9ea0-39c03de92c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75ec4764-6861-489f-9ea0-39c03de92c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1073001995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e661e59-52fb-4f9c-b8d2-16dc7cc6cd59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdda1a0eaf1540d6871d8eea61b6a0e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:44:37Z,use_quota=True,user_id='e63aafdffa894a16b4a4b00866aba5e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bbd8478-37f5-4cad-a98d-052fbb97eabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bbd8478-37f5-4cad-a98d-052fbb97eabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a8cfa3-8143-42e2-b2fa-97873f1bc5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a8cfa3-8143-42e2-b2fa-97873f1bc5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e661e59-52fb-4f9c-b8d2-16dc7cc6cd59', 'volume_name': 'volume-6e661e59-52fb-4f9c-b8d2-16dc7cc6cd59', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4b0f67d-e99d-4980-a763-d5daedd79727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4b0f67d-e99d-4980-a763-d5daedd79727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e0b5fa-4e40-4ab0-bd53-f0eb5ffd2d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:37 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] Volume 6e661e59-52fb-4f9c-b8d2-16dc7cc6cd59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e661e59-52fb-4f9c-b8d2-16dc7cc6cd59', 'volume_size': 1} Jul 17 19:44:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1073001995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e661e59-52fb-4f9c-b8d2-16dc7cc6cd59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdda1a0eaf1540d6871d8eea61b6a0e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:44:37Z,use_quota=True,user_id='e63aafdffa894a16b4a4b00866aba5e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:44:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] Creating volume 6e661e59-52fb-4f9c-b8d2-16dc7cc6cd59 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:44:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:44:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:44:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:44:37 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:44:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6e661e59-52fb-4f9c-b8d2-16dc7cc6cd59 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:37 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6e661e59-52fb-4f9c-b8d2-16dc7cc6cd59 1073741824 Jul 17 19:44:37 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:37 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6e661e59-52fb-4f9c-b8d2-16dc7cc6cd59 1073741824" returned: 0 in 0.575s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6e661e59-52fb-4f9c-b8d2-16dc7cc6cd59 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:38 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6e661e59-52fb-4f9c-b8d2-16dc7cc6cd59 Jul 17 19:44:38 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:38 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6e661e59-52fb-4f9c-b8d2-16dc7cc6cd59" returned: 0 in 0.284s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:38 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:44:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e0b5fa-4e40-4ab0-bd53-f0eb5ffd2d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e661e59-52fb-4f9c-b8d2-16dc7cc6cd59', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b2a4615-5feb-4e2c-9256-d3c3ca25f9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:38 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] Volume volume-6e661e59-52fb-4f9c-b8d2-16dc7cc6cd59 (6e661e59-52fb-4f9c-b8d2-16dc7cc6cd59): created successfully Jul 17 19:44:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b2a4615-5feb-4e2c-9256-d3c3ca25f9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] Flow 'volume_create_manager' (2782edeb-e3d8-4b31-96d9-bb79657b5220) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:44:38 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-d3bb9205-3d05-436d-a4dc-385b0b545e7e tempest-AttachVolumeTestJSON-1460626915 None] Created volume successfully. Jul 17 19:44:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-1cfa36ff-0ce7-4f1e-bf99-fa293359f96c req-36e758ab-5296-4336-831c-57c1c09bcb6c tempest-AttachVolumeTestJSON-1460626915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-1cfa36ff-0ce7-4f1e-bf99-fa293359f96c req-36e758ab-5296-4336-831c-57c1c09bcb6c tempest-AttachVolumeTestJSON-1460626915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-1cfa36ff-0ce7-4f1e-bf99-fa293359f96c req-36e758ab-5296-4336-831c-57c1c09bcb6c tempest-AttachVolumeTestJSON-1460626915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:40 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-1cfa36ff-0ce7-4f1e-bf99-fa293359f96c req-36e758ab-5296-4336-831c-57c1c09bcb6c tempest-AttachVolumeTestJSON-1460626915 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55', 'name': 'volume-6e661e59-52fb-4f9c-b8d2-16dc7cc6cd59', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '260e873b-19b5-4f7e-b331-6606b953b1ad', 'enforce_multipath': True} {{(pid=87726) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 19:44:40 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-1cfa36ff-0ce7-4f1e-bf99-fa293359f96c req-36e758ab-5296-4336-831c-57c1c09bcb6c tempest-AttachVolumeTestJSON-1460626915 None] attachment_update completed successfully. Jul 17 19:44:42 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-4e73f09d-7a5d-4692-a2c9-f9abae386032 req-10a41701-5be9-4bb2-8a94-82fb6eaf123e tempest-AttachVolumeTestJSON-1460626915 None] Terminate volume connection completed successfully. Jul 17 19:44:42 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-4e73f09d-7a5d-4692-a2c9-f9abae386032 req-10a41701-5be9-4bb2-8a94-82fb6eaf123e tempest-AttachVolumeTestJSON-1460626915 None] Deleting attachment 938d3c1e-9406-48fa-9fef-2795c89f8723. {{(pid=87726) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 19:44:43 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-d3e9910c-dd60-47b1-bf95-359e36916b7f req-81700214-4d4c-4399-b4b4-688c09a97938 tempest-AttachVolumeTestJSON-1460626915 None] Terminate volume connection completed successfully. Jul 17 19:44:43 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-d3e9910c-dd60-47b1-bf95-359e36916b7f req-81700214-4d4c-4399-b4b4-688c09a97938 tempest-AttachVolumeTestJSON-1460626915 None] Deleting attachment 260e873b-19b5-4f7e-b331-6606b953b1ad. {{(pid=87726) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 19:44:48 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2de55ca8-c07d-4cac-9ab3-676df4ce8e60 tempest-AttachVolumeTestJSON-1460626915 None] Acquiring lock "cinder-6e661e59-52fb-4f9c-b8d2-16dc7cc6cd59-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:44:48 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2de55ca8-c07d-4cac-9ab3-676df4ce8e60 tempest-AttachVolumeTestJSON-1460626915 None] Lock "cinder-6e661e59-52fb-4f9c-b8d2-16dc7cc6cd59-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:44:48 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=125,cinder:UPDATE=139,cinder:DELETE=16,cinder:INSERT=37 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:44:48 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:UPDATE=152,cinder:INSERT=38,cinder:SELECT=111,cinder:DELETE=10 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2de55ca8-c07d-4cac-9ab3-676df4ce8e60 tempest-AttachVolumeTestJSON-1460626915 None] Acquiring lock "cinder-quobyte-6e661e59-52fb-4f9c-b8d2-16dc7cc6cd59" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2de55ca8-c07d-4cac-9ab3-676df4ce8e60 tempest-AttachVolumeTestJSON-1460626915 None] Lock "cinder-quobyte-6e661e59-52fb-4f9c-b8d2-16dc7cc6cd59" acquired by "delete_volume" :: waited 0.026s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[3294ea0e-d2e0-4a26-abb0-aaa4ed370864]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2de55ca8-c07d-4cac-9ab3-676df4ce8e60 tempest-AttachVolumeTestJSON-1460626915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6e661e59-52fb-4f9c-b8d2-16dc7cc6cd59 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:49 devstack sudo[96989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6e661e59-52fb-4f9c-b8d2-16dc7cc6cd59 Jul 17 19:44:49 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:49 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2de55ca8-c07d-4cac-9ab3-676df4ce8e60 tempest-AttachVolumeTestJSON-1460626915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6e661e59-52fb-4f9c-b8d2-16dc7cc6cd59" returned: 0 in 0.445s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2de55ca8-c07d-4cac-9ab3-676df4ce8e60 tempest-AttachVolumeTestJSON-1460626915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6e661e59-52fb-4f9c-b8d2-16dc7cc6cd59 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:49 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6e661e59-52fb-4f9c-b8d2-16dc7cc6cd59 Jul 17 19:44:49 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] Flow 'volume_create_manager' (8666f9de-a030-4ee7-bb45-63b990ba342d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b51de92c-ab98-44e3-9210-c2983affa888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:49 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2de55ca8-c07d-4cac-9ab3-676df4ce8e60 tempest-AttachVolumeTestJSON-1460626915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6e661e59-52fb-4f9c-b8d2-16dc7cc6cd59" returned: 0 in 0.313s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b51de92c-ab98-44e3-9210-c2983affa888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2131932600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4419a83cc2a4b2c94682025b3c37207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:44:50Z,use_quota=True,user_id='4fda6d98187549b8ab0c2d701dfe5fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7ed8974-b8eb-4f67-86e8-4e4ad55e2502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7ed8974-b8eb-4f67-86e8-4e4ad55e2502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bb5cb96-e81a-4e46-a128-e92cafb7e9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bb5cb96-e81a-4e46-a128-e92cafb7e9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05', 'volume_name': 'volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e8f8947-49f3-4018-ba79-15c0cc3f2d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e8f8947-49f3-4018-ba79-15c0cc3f2d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9dd621a-a9e8-42e9-b4b6-f5dd941da829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:49 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] Volume 2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05', 'volume_size': 1} Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2131932600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4419a83cc2a4b2c94682025b3c37207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:44:50Z,use_quota=True,user_id='4fda6d98187549b8ab0c2d701dfe5fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] Creating volume 2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:44:49 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2de55ca8-c07d-4cac-9ab3-676df4ce8e60 tempest-AttachVolumeTestJSON-1460626915 None] Lock "cinder-quobyte-6e661e59-52fb-4f9c-b8d2-16dc7cc6cd59" released by "delete_volume" :: held 0.874s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:44:49 devstack sudo[96998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05 1073741824 Jul 17 19:44:49 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:49 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-2de55ca8-c07d-4cac-9ab3-676df4ce8e60 tempest-AttachVolumeTestJSON-1460626915 None] Created reservations ['7f31468e-9612-4260-bf20-67c068d21575', '797339af-b697-4ea8-9c0c-f91fe66ed4ae', '3d725e84-58dd-46cd-be78-327377025abf', '01230797-e86b-4844-929c-986b56492066'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:44:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-2de55ca8-c07d-4cac-9ab3-676df4ce8e60 tempest-AttachVolumeTestJSON-1460626915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-2de55ca8-c07d-4cac-9ab3-676df4ce8e60 tempest-AttachVolumeTestJSON-1460626915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:50 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-2de55ca8-c07d-4cac-9ab3-676df4ce8e60 tempest-AttachVolumeTestJSON-1460626915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:44:50 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-2de55ca8-c07d-4cac-9ab3-676df4ce8e60 tempest-AttachVolumeTestJSON-1460626915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:44:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-2de55ca8-c07d-4cac-9ab3-676df4ce8e60 tempest-AttachVolumeTestJSON-1460626915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2de55ca8-c07d-4cac-9ab3-676df4ce8e60 tempest-AttachVolumeTestJSON-1460626915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:50 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:44:50 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:50 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ffcda9d9-ac8a-4ae5-af3e-a8c2632997f8 tempest-AttachVolumeTestJSON-1460626915 None] Acquiring lock "cinder-84b3af6f-2b3b-4472-9ad8-5b21a713e87a-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:44:50 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ffcda9d9-ac8a-4ae5-af3e-a8c2632997f8 tempest-AttachVolumeTestJSON-1460626915 None] Lock "cinder-84b3af6f-2b3b-4472-9ad8-5b21a713e87a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:44:50 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ffcda9d9-ac8a-4ae5-af3e-a8c2632997f8 tempest-AttachVolumeTestJSON-1460626915 None] Acquiring lock "cinder-quobyte-84b3af6f-2b3b-4472-9ad8-5b21a713e87a" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:44:50 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ffcda9d9-ac8a-4ae5-af3e-a8c2632997f8 tempest-AttachVolumeTestJSON-1460626915 None] Lock "cinder-quobyte-84b3af6f-2b3b-4472-9ad8-5b21a713e87a" acquired by "delete_volume" :: waited 0.033s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:44:50 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[43eaaba6-f9d2-41c2-89da-ae2f91bf159c]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:44:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ffcda9d9-ac8a-4ae5-af3e-a8c2632997f8 tempest-AttachVolumeTestJSON-1460626915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84b3af6f-2b3b-4472-9ad8-5b21a713e87a {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:50 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2de55ca8-c07d-4cac-9ab3-676df4ce8e60 tempest-AttachVolumeTestJSON-1460626915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.329s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:50 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-2de55ca8-c07d-4cac-9ab3-676df4ce8e60 tempest-AttachVolumeTestJSON-1460626915 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:44:50 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-2de55ca8-c07d-4cac-9ab3-676df4ce8e60 tempest-AttachVolumeTestJSON-1460626915 None] Deleted volume successfully. Jul 17 19:44:50 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2de55ca8-c07d-4cac-9ab3-676df4ce8e60 tempest-AttachVolumeTestJSON-1460626915 None] Lock "cinder-6e661e59-52fb-4f9c-b8d2-16dc7cc6cd59-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:44:50 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84b3af6f-2b3b-4472-9ad8-5b21a713e87a Jul 17 19:44:50 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:50 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05 1073741824" returned: 0 in 0.546s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:50 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05 Jul 17 19:44:50 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:50 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ffcda9d9-ac8a-4ae5-af3e-a8c2632997f8 tempest-AttachVolumeTestJSON-1460626915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84b3af6f-2b3b-4472-9ad8-5b21a713e87a" returned: 0 in 0.413s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ffcda9d9-ac8a-4ae5-af3e-a8c2632997f8 tempest-AttachVolumeTestJSON-1460626915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84b3af6f-2b3b-4472-9ad8-5b21a713e87a {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:50 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84b3af6f-2b3b-4472-9ad8-5b21a713e87a Jul 17 19:44:50 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:50 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05" returned: 0 in 0.271s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:50 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:44:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:50 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9dd621a-a9e8-42e9-b4b6-f5dd941da829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:50 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf3221d-c82f-484a-ab5a-064de2a6896e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:50 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] Volume volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05 (2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05): created successfully Jul 17 19:44:50 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf3221d-c82f-484a-ab5a-064de2a6896e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:50 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] Flow 'volume_create_manager' (8666f9de-a030-4ee7-bb45-63b990ba342d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:44:50 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-b2f6f85b-dba0-4f3f-8fd7-96857d28084e tempest-VolumesSnapshotTestJSON-1650241216 None] Created volume successfully. Jul 17 19:44:50 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ffcda9d9-ac8a-4ae5-af3e-a8c2632997f8 tempest-AttachVolumeTestJSON-1460626915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-84b3af6f-2b3b-4472-9ad8-5b21a713e87a" returned: 0 in 0.286s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:51 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ffcda9d9-ac8a-4ae5-af3e-a8c2632997f8 tempest-AttachVolumeTestJSON-1460626915 None] Lock "cinder-quobyte-84b3af6f-2b3b-4472-9ad8-5b21a713e87a" released by "delete_volume" :: held 0.747s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:44:51 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-ffcda9d9-ac8a-4ae5-af3e-a8c2632997f8 tempest-AttachVolumeTestJSON-1460626915 None] Created reservations ['6a7ac8af-f3cc-47a8-91f1-0b6e4d2986b4', '81145c4e-8663-4111-9fe9-917bf777c8ba', '8611fb44-d5fc-4dc8-9dbc-8563f4db4b2e', 'adcdbce1-e6b4-4437-b805-5301e05439d1'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:44:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ffcda9d9-ac8a-4ae5-af3e-a8c2632997f8 tempest-AttachVolumeTestJSON-1460626915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ffcda9d9-ac8a-4ae5-af3e-a8c2632997f8 tempest-AttachVolumeTestJSON-1460626915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:51 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ffcda9d9-ac8a-4ae5-af3e-a8c2632997f8 tempest-AttachVolumeTestJSON-1460626915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:44:51 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ffcda9d9-ac8a-4ae5-af3e-a8c2632997f8 tempest-AttachVolumeTestJSON-1460626915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:44:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ffcda9d9-ac8a-4ae5-af3e-a8c2632997f8 tempest-AttachVolumeTestJSON-1460626915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ffcda9d9-ac8a-4ae5-af3e-a8c2632997f8 tempest-AttachVolumeTestJSON-1460626915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:51 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:44:51 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:51 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ffcda9d9-ac8a-4ae5-af3e-a8c2632997f8 tempest-AttachVolumeTestJSON-1460626915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.270s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:51 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-ffcda9d9-ac8a-4ae5-af3e-a8c2632997f8 tempest-AttachVolumeTestJSON-1460626915 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:44:51 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-ffcda9d9-ac8a-4ae5-af3e-a8c2632997f8 tempest-AttachVolumeTestJSON-1460626915 None] Deleted volume successfully. Jul 17 19:44:51 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ffcda9d9-ac8a-4ae5-af3e-a8c2632997f8 tempest-AttachVolumeTestJSON-1460626915 None] Lock "cinder-84b3af6f-2b3b-4472-9ad8-5b21a713e87a-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:44:51 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ae655659-0002-45c0-bfdf-ce923bf15306 tempest-AttachVolumeTestJSON-1460626915 None] Acquiring lock "cinder-f21ef10a-f14d-4495-a253-e2e28d2dcf5f-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:44:51 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ae655659-0002-45c0-bfdf-ce923bf15306 tempest-AttachVolumeTestJSON-1460626915 None] Lock "cinder-f21ef10a-f14d-4495-a253-e2e28d2dcf5f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:44:51 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ae655659-0002-45c0-bfdf-ce923bf15306 tempest-AttachVolumeTestJSON-1460626915 None] Acquiring lock "cinder-quobyte-f21ef10a-f14d-4495-a253-e2e28d2dcf5f" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:44:51 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ae655659-0002-45c0-bfdf-ce923bf15306 tempest-AttachVolumeTestJSON-1460626915 None] Lock "cinder-quobyte-f21ef10a-f14d-4495-a253-e2e28d2dcf5f" acquired by "delete_volume" :: waited 0.024s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:44:51 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[197aa17f-2c6c-4b78-bc05-ac8fd8303bc5]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:44:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ae655659-0002-45c0-bfdf-ce923bf15306 tempest-AttachVolumeTestJSON-1460626915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f21ef10a-f14d-4495-a253-e2e28d2dcf5f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:51 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f21ef10a-f14d-4495-a253-e2e28d2dcf5f Jul 17 19:44:51 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:51 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ae655659-0002-45c0-bfdf-ce923bf15306 tempest-AttachVolumeTestJSON-1460626915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f21ef10a-f14d-4495-a253-e2e28d2dcf5f" returned: 0 in 0.406s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ae655659-0002-45c0-bfdf-ce923bf15306 tempest-AttachVolumeTestJSON-1460626915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f21ef10a-f14d-4495-a253-e2e28d2dcf5f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:51 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f21ef10a-f14d-4495-a253-e2e28d2dcf5f Jul 17 19:44:51 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] Flow 'volume_create_manager' (ec9bd836-d104-41ce-92c9-0557681c68e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f882977-7cee-48dc-a8af-082ff36d863e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f882977-7cee-48dc-a8af-082ff36d863e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1877882495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a249ee-f882-47d2-b2af-072cf7a62f41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab82e6259dfe4ca4a31155929f92bb85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:44:52Z,use_quota=True,user_id='697c8081cc3f4dc49485b7498a5ee100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2441cff9-2158-4f5f-8d4a-486b94a1cd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2441cff9-2158-4f5f-8d4a-486b94a1cd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:52 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a48b3e-d67b-4243-b089-6d5f520bc6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a48b3e-d67b-4243-b089-6d5f520bc6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86a249ee-f882-47d2-b2af-072cf7a62f41', 'volume_name': 'volume-86a249ee-f882-47d2-b2af-072cf7a62f41', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c356cc7-a4eb-4426-88b5-6075a6090601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c356cc7-a4eb-4426-88b5-6075a6090601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c26f4ec9-20fc-410d-8d70-ee3371c20933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:52 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] Volume 86a249ee-f882-47d2-b2af-072cf7a62f41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86a249ee-f882-47d2-b2af-072cf7a62f41', 'volume_size': 1} Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1877882495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a249ee-f882-47d2-b2af-072cf7a62f41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab82e6259dfe4ca4a31155929f92bb85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:44:52Z,use_quota=True,user_id='697c8081cc3f4dc49485b7498a5ee100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] Creating volume 86a249ee-f882-47d2-b2af-072cf7a62f41 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:44:52 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-86a249ee-f882-47d2-b2af-072cf7a62f41 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ae655659-0002-45c0-bfdf-ce923bf15306 tempest-AttachVolumeTestJSON-1460626915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f21ef10a-f14d-4495-a253-e2e28d2dcf5f" returned: 0 in 0.327s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:52 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-86a249ee-f882-47d2-b2af-072cf7a62f41 1073741824 Jul 17 19:44:52 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-817bff8f-a58b-4258-9271-2a7fe69f68b8 tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ae655659-0002-45c0-bfdf-ce923bf15306 tempest-AttachVolumeTestJSON-1460626915 None] Lock "cinder-quobyte-f21ef10a-f14d-4495-a253-e2e28d2dcf5f" released by "delete_volume" :: held 0.789s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-ae655659-0002-45c0-bfdf-ce923bf15306 tempest-AttachVolumeTestJSON-1460626915 None] Created reservations ['f90665df-3cc8-49db-b986-69eb1ffc17bc', '34182060-56c1-4677-89ba-b5289d8879fc', '642bc94c-26d7-4493-91ca-06948c5d90f4', '6431ace5-7897-4c4e-a18e-678ed9693f7b'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ae655659-0002-45c0-bfdf-ce923bf15306 tempest-AttachVolumeTestJSON-1460626915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ae655659-0002-45c0-bfdf-ce923bf15306 tempest-AttachVolumeTestJSON-1460626915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ae655659-0002-45c0-bfdf-ce923bf15306 tempest-AttachVolumeTestJSON-1460626915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ae655659-0002-45c0-bfdf-ce923bf15306 tempest-AttachVolumeTestJSON-1460626915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ae655659-0002-45c0-bfdf-ce923bf15306 tempest-AttachVolumeTestJSON-1460626915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ae655659-0002-45c0-bfdf-ce923bf15306 tempest-AttachVolumeTestJSON-1460626915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:52 devstack sudo[97034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:44:52 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:52 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ae655659-0002-45c0-bfdf-ce923bf15306 tempest-AttachVolumeTestJSON-1460626915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.267s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-ae655659-0002-45c0-bfdf-ce923bf15306 tempest-AttachVolumeTestJSON-1460626915 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:44:52 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-ae655659-0002-45c0-bfdf-ce923bf15306 tempest-AttachVolumeTestJSON-1460626915 None] Deleted volume successfully. Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ae655659-0002-45c0-bfdf-ce923bf15306 tempest-AttachVolumeTestJSON-1460626915 None] Lock "cinder-f21ef10a-f14d-4495-a253-e2e28d2dcf5f-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:44:52 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-86a249ee-f882-47d2-b2af-072cf7a62f41 1073741824" returned: 0 in 0.518s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-86a249ee-f882-47d2-b2af-072cf7a62f41 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:52 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-86a249ee-f882-47d2-b2af-072cf7a62f41 Jul 17 19:44:52 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:53 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-86a249ee-f882-47d2-b2af-072cf7a62f41" returned: 0 in 0.270s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:53 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:44:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-817bff8f-a58b-4258-9271-2a7fe69f68b8 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.793s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:53 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c26f4ec9-20fc-410d-8d70-ee3371c20933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86a249ee-f882-47d2-b2af-072cf7a62f41', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:53 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (726bee7e-b44d-4d08-bf16-4d1fdb1bfa55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:53 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-817bff8f-a58b-4258-9271-2a7fe69f68b8 tempest-VolumesSnapshotTestJSON-1650241216 None] Creating offline snapshot ededf87e-5bc8-41d8-8145-c4d681ed17f3 of volume 2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:44:53 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84e6744-3167-4d9d-85ac-0b5d01b11ca1]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:44:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-817bff8f-a58b-4258-9271-2a7fe69f68b8 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:53 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] Volume volume-86a249ee-f882-47d2-b2af-072cf7a62f41 (86a249ee-f882-47d2-b2af-072cf7a62f41): created successfully Jul 17 19:44:53 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (726bee7e-b44d-4d08-bf16-4d1fdb1bfa55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:53 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] Flow 'volume_create_manager' (ec9bd836-d104-41ce-92c9-0557681c68e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:44:53 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-0b189391-401a-43f5-b13e-11e8e67eb6f0 tempest-AttachVolumeNegativeTest-1875054094 None] Created volume successfully. Jul 17 19:44:53 devstack sudo[97044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05 Jul 17 19:44:53 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:53 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-817bff8f-a58b-4258-9271-2a7fe69f68b8 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05" returned: 0 in 0.376s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-817bff8f-a58b-4258-9271-2a7fe69f68b8 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05.ededf87e-5bc8-41d8-8145-c4d681ed17f3 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:53 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05.ededf87e-5bc8-41d8-8145-c4d681ed17f3 1G Jul 17 19:44:53 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:53 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-817bff8f-a58b-4258-9271-2a7fe69f68b8 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05.ededf87e-5bc8-41d8-8145-c4d681ed17f3 1G" returned: 0 in 0.405s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-817bff8f-a58b-4258-9271-2a7fe69f68b8 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05.ededf87e-5bc8-41d8-8145-c4d681ed17f3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:53 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05.ededf87e-5bc8-41d8-8145-c4d681ed17f3 Jul 17 19:44:53 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:54 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-817bff8f-a58b-4258-9271-2a7fe69f68b8 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05.ededf87e-5bc8-41d8-8145-c4d681ed17f3" returned: 0 in 0.348s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:54 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-817bff8f-a58b-4258-9271-2a7fe69f68b8 tempest-VolumesSnapshotTestJSON-1650241216 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05.ededf87e-5bc8-41d8-8145-c4d681ed17f3 is being set with open permissions: ugo+rw Jul 17 19:44:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-817bff8f-a58b-4258-9271-2a7fe69f68b8 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05.ededf87e-5bc8-41d8-8145-c4d681ed17f3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:54 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05.ededf87e-5bc8-41d8-8145-c4d681ed17f3 Jul 17 19:44:54 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:54 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-817bff8f-a58b-4258-9271-2a7fe69f68b8 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05.ededf87e-5bc8-41d8-8145-c4d681ed17f3" returned: 0 in 0.302s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-817bff8f-a58b-4258-9271-2a7fe69f68b8 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:54 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05.info Jul 17 19:44:54 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:54 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-817bff8f-a58b-4258-9271-2a7fe69f68b8 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05.info" returned: 0 in 0.319s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:54 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-817bff8f-a58b-4258-9271-2a7fe69f68b8 tempest-VolumesSnapshotTestJSON-1650241216 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05.info is being set with open permissions: ugo+rw Jul 17 19:44:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-817bff8f-a58b-4258-9271-2a7fe69f68b8 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:54 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05.info Jul 17 19:44:54 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-cb965d1c-49a6-4ef5-a216-61078862a6e9 req-46580991-cbda-4748-92a4-663dc4f74773 tempest-AttachVolumeNegativeTest-1875054094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:55 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-817bff8f-a58b-4258-9271-2a7fe69f68b8 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05.info" returned: 0 in 0.266s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-817bff8f-a58b-4258-9271-2a7fe69f68b8 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.140s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-cb965d1c-49a6-4ef5-a216-61078862a6e9 req-46580991-cbda-4748-92a4-663dc4f74773 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.256s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-cb965d1c-49a6-4ef5-a216-61078862a6e9 req-46580991-cbda-4748-92a4-663dc4f74773 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-cb965d1c-49a6-4ef5-a216-61078862a6e9 req-46580991-cbda-4748-92a4-663dc4f74773 tempest-AttachVolumeNegativeTest-1875054094 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55', 'name': 'volume-86a249ee-f882-47d2-b2af-072cf7a62f41', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '87efb492-e3df-48e0-b1df-acad2b5d8462', 'enforce_multipath': True} {{(pid=87726) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 19:44:55 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-817bff8f-a58b-4258-9271-2a7fe69f68b8 tempest-VolumesSnapshotTestJSON-1650241216 None] Create snapshot completed successfully Jul 17 19:44:55 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-cb965d1c-49a6-4ef5-a216-61078862a6e9 req-46580991-cbda-4748-92a4-663dc4f74773 tempest-AttachVolumeNegativeTest-1875054094 None] attachment_update completed successfully. Jul 17 19:44:56 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e64e776c-1c40-4296-9c60-b375df8c2f5c tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "cinder-ededf87e-5bc8-41d8-8145-c4d681ed17f3-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:44:56 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e64e776c-1c40-4296-9c60-b375df8c2f5c tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-ededf87e-5bc8-41d8-8145-c4d681ed17f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:44:56 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e64e776c-1c40-4296-9c60-b375df8c2f5c tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "cinder-quobyte-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:44:56 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e64e776c-1c40-4296-9c60-b375df8c2f5c tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-quobyte-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:44:56 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e64e776c-1c40-4296-9c60-b375df8c2f5c tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "cinder-quobyte-ededf87e-5bc8-41d8-8145-c4d681ed17f3" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:44:56 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e64e776c-1c40-4296-9c60-b375df8c2f5c tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-quobyte-ededf87e-5bc8-41d8-8145-c4d681ed17f3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:44:56 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-e64e776c-1c40-4296-9c60-b375df8c2f5c tempest-VolumesSnapshotTestJSON-1650241216 None] Deleting offline snapshot ededf87e-5bc8-41d8-8145-c4d681ed17f3 of volume 2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:44:56 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-e64e776c-1c40-4296-9c60-b375df8c2f5c tempest-VolumesSnapshotTestJSON-1650241216 None] snapshot_file for this snap is: volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05.ededf87e-5bc8-41d8-8145-c4d681ed17f3 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:44:56 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea0dd50-09e7-4072-ad95-c15bbf1644bb]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:44:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e64e776c-1c40-4296-9c60-b375df8c2f5c tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05.ededf87e-5bc8-41d8-8145-c4d681ed17f3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:56 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05.ededf87e-5bc8-41d8-8145-c4d681ed17f3 Jul 17 19:44:56 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:57 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e64e776c-1c40-4296-9c60-b375df8c2f5c tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05.ededf87e-5bc8-41d8-8145-c4d681ed17f3" returned: 0 in 0.478s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:57 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-e64e776c-1c40-4296-9c60-b375df8c2f5c tempest-VolumesSnapshotTestJSON-1650241216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:44:57 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[54935cd9-67e6-494d-be46-a1bba3aeeebf]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:44:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e64e776c-1c40-4296-9c60-b375df8c2f5c tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:57 devstack sudo[97478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05 Jul 17 19:44:57 devstack sudo[97478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:57 devstack sudo[97478]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e64e776c-1c40-4296-9c60-b375df8c2f5c tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05" returned: 0 in 0.460s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e64e776c-1c40-4296-9c60-b375df8c2f5c tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05.ededf87e-5bc8-41d8-8145-c4d681ed17f3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:57 devstack sudo[97483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05.ededf87e-5bc8-41d8-8145-c4d681ed17f3 Jul 17 19:44:57 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:57 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-27b07115-4f93-4593-8e09-8a6241ebd0a1 req-4f839e16-d0e7-419c-b2ea-303a64596ad5 tempest-AttachVolumeNegativeTest-1875054094 None] Terminate volume connection completed successfully. Jul 17 19:44:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-27b07115-4f93-4593-8e09-8a6241ebd0a1 req-4f839e16-d0e7-419c-b2ea-303a64596ad5 tempest-AttachVolumeNegativeTest-1875054094 None] Deleting attachment 87efb492-e3df-48e0-b1df-acad2b5d8462. {{(pid=87726) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 19:44:58 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e64e776c-1c40-4296-9c60-b375df8c2f5c tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05.ededf87e-5bc8-41d8-8145-c4d681ed17f3" returned: 0 in 0.415s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e64e776c-1c40-4296-9c60-b375df8c2f5c tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05.ededf87e-5bc8-41d8-8145-c4d681ed17f3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:58 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05.ededf87e-5bc8-41d8-8145-c4d681ed17f3 Jul 17 19:44:58 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:44:58 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Jul 17 19:44:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e64e776c-1c40-4296-9c60-b375df8c2f5c tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05.ededf87e-5bc8-41d8-8145-c4d681ed17f3" returned: 0 in 0.264s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:44:58 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e64e776c-1c40-4296-9c60-b375df8c2f5c tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-quobyte-ededf87e-5bc8-41d8-8145-c4d681ed17f3" released by "_delete_snapshot" :: held 1.740s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:44:58 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e64e776c-1c40-4296-9c60-b375df8c2f5c tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-quobyte-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05" released by "delete_snapshot" :: held 1.763s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:44:58 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-e64e776c-1c40-4296-9c60-b375df8c2f5c tempest-VolumesSnapshotTestJSON-1650241216 None] Created reservations ['0fe6d64d-2085-4b55-9ae3-08e6bfc3c8f9', 'b64fcc09-132f-4b99-9de3-e2f8d807d4c3', '5e7037aa-9fc6-4e26-a857-852a72a4af5e', '7e8581f9-72e3-436f-b3b6-361ce7a4fd6e'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:44:58 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e64e776c-1c40-4296-9c60-b375df8c2f5c tempest-VolumesSnapshotTestJSON-1650241216 None] Delete snapshot completed successfully. Jul 17 19:44:58 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e64e776c-1c40-4296-9c60-b375df8c2f5c tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-ededf87e-5bc8-41d8-8145-c4d681ed17f3-delete_snapshot" released by "delete_snapshot" :: held 1.939s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:44:59 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:44:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] Flow 'volume_create_manager' (01a7c314-b1b8-4884-831e-fca3902028d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:44:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c12c296-f2b1-4247-8333-5c3a73da5088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c12c296-f2b1-4247-8333-5c3a73da5088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1308569090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82fa3b75-8dca-40fa-928b-7fd402a55303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4419a83cc2a4b2c94682025b3c37207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:45:00Z,use_quota=True,user_id='4fda6d98187549b8ab0c2d701dfe5fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dacf57a-852c-4d1c-8530-97bde45fd85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dacf57a-852c-4d1c-8530-97bde45fd85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9974266-642b-4e34-a29d-8b275d27d380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9974266-642b-4e34-a29d-8b275d27d380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82fa3b75-8dca-40fa-928b-7fd402a55303', 'volume_name': 'volume-82fa3b75-8dca-40fa-928b-7fd402a55303', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebc2c566-6ab5-414b-9304-694381a90b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebc2c566-6ab5-414b-9304-694381a90b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:44:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b25902e4-9316-4b4e-b114-09d7e7ab0c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:44:59 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] Volume 82fa3b75-8dca-40fa-928b-7fd402a55303: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82fa3b75-8dca-40fa-928b-7fd402a55303', 'volume_size': 1} Jul 17 19:44:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:59 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1308569090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82fa3b75-8dca-40fa-928b-7fd402a55303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4419a83cc2a4b2c94682025b3c37207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:45:00Z,use_quota=True,user_id='4fda6d98187549b8ab0c2d701dfe5fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:44:59 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] Creating volume 82fa3b75-8dca-40fa-928b-7fd402a55303 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:44:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:44:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:44:59 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:44:59 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:44:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:44:59 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:44:59 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:44:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:44:59 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303 1073741824 Jul 17 19:44:59 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:00 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303 1073741824" returned: 0 in 0.590s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:00 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303 Jul 17 19:45:00 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:00 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303" returned: 0 in 0.404s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:00 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:45:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b25902e4-9316-4b4e-b114-09d7e7ab0c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82fa3b75-8dca-40fa-928b-7fd402a55303', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de572c61-2a3c-44be-acc8-b64c9d905319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f78bb427-73bf-4652-8bbc-8b29180d1010 tempest-BackendsCapabilitiesAdminTestsJSON-258659180 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7513999938965, 'free_capacity_gb': 1775.7513999938965, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87726) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 17 19:45:00 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] Volume volume-82fa3b75-8dca-40fa-928b-7fd402a55303 (82fa3b75-8dca-40fa-928b-7fd402a55303): created successfully Jul 17 19:45:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de572c61-2a3c-44be-acc8-b64c9d905319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] Flow 'volume_create_manager' (01a7c314-b1b8-4884-831e-fca3902028d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:45:00 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-fc881ca7-1faf-491a-a1c7-0ce05394810f tempest-VolumesSnapshotTestJSON-1650241216 None] Created volume successfully. Jul 17 19:45:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a2a59265-0b7e-4801-aded-d6491561b767 tempest-BackendsCapabilitiesAdminTestsJSON-258659180 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7513999938965, 'free_capacity_gb': 1775.7513999938965, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87726) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 17 19:45:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-005d4349-7f97-4e0c-be0f-7d8160569f17 tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-005d4349-7f97-4e0c-be0f-7d8160569f17 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:01 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-005d4349-7f97-4e0c-be0f-7d8160569f17 tempest-VolumesSnapshotTestJSON-1650241216 None] Creating offline snapshot 5a2ba6f6-fb5e-423a-b5cd-78ba097210b9 of volume 82fa3b75-8dca-40fa-928b-7fd402a55303 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:45:01 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34864a6-5e68-4b2d-a9af-bea7597c6fff]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-005d4349-7f97-4e0c-be0f-7d8160569f17 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:02 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303 Jul 17 19:45:02 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:02 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-005d4349-7f97-4e0c-be0f-7d8160569f17 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303" returned: 0 in 0.419s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-005d4349-7f97-4e0c-be0f-7d8160569f17 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303.5a2ba6f6-fb5e-423a-b5cd-78ba097210b9 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:02 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303.5a2ba6f6-fb5e-423a-b5cd-78ba097210b9 1G Jul 17 19:45:02 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:02 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9a15392c-f620-44be-a73f-c7787ea4a747 tempest-AttachVolumeNegativeTest-1875054094 None] Acquiring lock "cinder-86a249ee-f882-47d2-b2af-072cf7a62f41-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:02 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9a15392c-f620-44be-a73f-c7787ea4a747 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "cinder-86a249ee-f882-47d2-b2af-072cf7a62f41-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:02 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9a15392c-f620-44be-a73f-c7787ea4a747 tempest-AttachVolumeNegativeTest-1875054094 None] Acquiring lock "cinder-quobyte-86a249ee-f882-47d2-b2af-072cf7a62f41" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:02 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9a15392c-f620-44be-a73f-c7787ea4a747 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "cinder-quobyte-86a249ee-f882-47d2-b2af-072cf7a62f41" acquired by "delete_volume" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:02 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[86229816-c174-45fb-aeb9-45ce04f2bf5a]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9a15392c-f620-44be-a73f-c7787ea4a747 tempest-AttachVolumeNegativeTest-1875054094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-86a249ee-f882-47d2-b2af-072cf7a62f41 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:02 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-005d4349-7f97-4e0c-be0f-7d8160569f17 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303.5a2ba6f6-fb5e-423a-b5cd-78ba097210b9 1G" returned: 0 in 0.565s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-005d4349-7f97-4e0c-be0f-7d8160569f17 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82fa3b75-8dca-40fa-928b-7fd402a55303 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303.5a2ba6f6-fb5e-423a-b5cd-78ba097210b9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:03 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82fa3b75-8dca-40fa-928b-7fd402a55303 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303.5a2ba6f6-fb5e-423a-b5cd-78ba097210b9 Jul 17 19:45:03 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:03 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-86a249ee-f882-47d2-b2af-072cf7a62f41 Jul 17 19:45:03 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:03 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-005d4349-7f97-4e0c-be0f-7d8160569f17 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82fa3b75-8dca-40fa-928b-7fd402a55303 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303.5a2ba6f6-fb5e-423a-b5cd-78ba097210b9" returned: 0 in 0.352s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:03 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-005d4349-7f97-4e0c-be0f-7d8160569f17 tempest-VolumesSnapshotTestJSON-1650241216 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303.5a2ba6f6-fb5e-423a-b5cd-78ba097210b9 is being set with open permissions: ugo+rw Jul 17 19:45:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-005d4349-7f97-4e0c-be0f-7d8160569f17 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303.5a2ba6f6-fb5e-423a-b5cd-78ba097210b9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:03 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9a15392c-f620-44be-a73f-c7787ea4a747 tempest-AttachVolumeNegativeTest-1875054094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-86a249ee-f882-47d2-b2af-072cf7a62f41" returned: 0 in 0.412s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9a15392c-f620-44be-a73f-c7787ea4a747 tempest-AttachVolumeNegativeTest-1875054094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-86a249ee-f882-47d2-b2af-072cf7a62f41 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:03 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303.5a2ba6f6-fb5e-423a-b5cd-78ba097210b9 Jul 17 19:45:03 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:03 devstack sudo[97579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-86a249ee-f882-47d2-b2af-072cf7a62f41 Jul 17 19:45:03 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:03 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-005d4349-7f97-4e0c-be0f-7d8160569f17 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303.5a2ba6f6-fb5e-423a-b5cd-78ba097210b9" returned: 0 in 0.278s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:03 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9a15392c-f620-44be-a73f-c7787ea4a747 tempest-AttachVolumeNegativeTest-1875054094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-86a249ee-f882-47d2-b2af-072cf7a62f41" returned: 0 in 0.278s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:03 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9a15392c-f620-44be-a73f-c7787ea4a747 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "cinder-quobyte-86a249ee-f882-47d2-b2af-072cf7a62f41" released by "delete_volume" :: held 0.736s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-005d4349-7f97-4e0c-be0f-7d8160569f17 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:03 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303.info Jul 17 19:45:03 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:03 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-9a15392c-f620-44be-a73f-c7787ea4a747 tempest-AttachVolumeNegativeTest-1875054094 None] Created reservations ['524b8e41-148d-40b0-a0c6-b0961a6c64db', '7bc6de86-5587-46e2-a9f2-53c256c9d57e', 'ac7bb958-c5ad-4bf8-8c77-f50262acfd5f', '150f71c5-b0f7-44a1-8268-3efae11112c2'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:45:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9a15392c-f620-44be-a73f-c7787ea4a747 tempest-AttachVolumeNegativeTest-1875054094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9a15392c-f620-44be-a73f-c7787ea4a747 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:03 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9a15392c-f620-44be-a73f-c7787ea4a747 tempest-AttachVolumeNegativeTest-1875054094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:45:03 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9a15392c-f620-44be-a73f-c7787ea4a747 tempest-AttachVolumeNegativeTest-1875054094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:45:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9a15392c-f620-44be-a73f-c7787ea4a747 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9a15392c-f620-44be-a73f-c7787ea4a747 tempest-AttachVolumeNegativeTest-1875054094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:03 devstack sudo[97585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:45:03 devstack sudo[97585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:03 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-005d4349-7f97-4e0c-be0f-7d8160569f17 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303.info" returned: 0 in 0.293s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:03 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-005d4349-7f97-4e0c-be0f-7d8160569f17 tempest-VolumesSnapshotTestJSON-1650241216 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303.info is being set with open permissions: ugo+rw Jul 17 19:45:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-005d4349-7f97-4e0c-be0f-7d8160569f17 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:04 devstack sudo[97588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303.info Jul 17 19:45:04 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:04 devstack sudo[97585]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9a15392c-f620-44be-a73f-c7787ea4a747 tempest-AttachVolumeNegativeTest-1875054094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.314s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:04 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-9a15392c-f620-44be-a73f-c7787ea4a747 tempest-AttachVolumeNegativeTest-1875054094 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:45:04 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-9a15392c-f620-44be-a73f-c7787ea4a747 tempest-AttachVolumeNegativeTest-1875054094 None] Deleted volume successfully. Jul 17 19:45:04 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9a15392c-f620-44be-a73f-c7787ea4a747 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "cinder-86a249ee-f882-47d2-b2af-072cf7a62f41-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:04 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c9696729-b755-4686-9e11-943d794e83a0 tempest-AttachVolumeNegativeTest-1875054094 None] Acquiring lock "cinder-63b3b4b7-fbd9-4ec1-af4c-78ea3dca9f81-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:04 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c9696729-b755-4686-9e11-943d794e83a0 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "cinder-63b3b4b7-fbd9-4ec1-af4c-78ea3dca9f81-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:04 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c9696729-b755-4686-9e11-943d794e83a0 tempest-AttachVolumeNegativeTest-1875054094 None] Acquiring lock "cinder-quobyte-63b3b4b7-fbd9-4ec1-af4c-78ea3dca9f81" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:04 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c9696729-b755-4686-9e11-943d794e83a0 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "cinder-quobyte-63b3b4b7-fbd9-4ec1-af4c-78ea3dca9f81" acquired by "delete_volume" :: waited 0.028s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:04 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f770d0f-c7e8-4d5f-b3ad-866830d068e8]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:04 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c9696729-b755-4686-9e11-943d794e83a0 tempest-AttachVolumeNegativeTest-1875054094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-63b3b4b7-fbd9-4ec1-af4c-78ea3dca9f81 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-005d4349-7f97-4e0c-be0f-7d8160569f17 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303.info" returned: 0 in 0.359s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-005d4349-7f97-4e0c-be0f-7d8160569f17 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.390s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:04 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-005d4349-7f97-4e0c-be0f-7d8160569f17 tempest-VolumesSnapshotTestJSON-1650241216 None] Create snapshot completed successfully Jul 17 19:45:04 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-63b3b4b7-fbd9-4ec1-af4c-78ea3dca9f81 Jul 17 19:45:04 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:04 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c9696729-b755-4686-9e11-943d794e83a0 tempest-AttachVolumeNegativeTest-1875054094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-63b3b4b7-fbd9-4ec1-af4c-78ea3dca9f81" returned: 0 in 0.384s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c9696729-b755-4686-9e11-943d794e83a0 tempest-AttachVolumeNegativeTest-1875054094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-63b3b4b7-fbd9-4ec1-af4c-78ea3dca9f81 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:04 devstack sudo[97597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-63b3b4b7-fbd9-4ec1-af4c-78ea3dca9f81 Jul 17 19:45:04 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:04 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c9696729-b755-4686-9e11-943d794e83a0 tempest-AttachVolumeNegativeTest-1875054094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-63b3b4b7-fbd9-4ec1-af4c-78ea3dca9f81" returned: 0 in 0.250s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:04 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c9696729-b755-4686-9e11-943d794e83a0 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "cinder-quobyte-63b3b4b7-fbd9-4ec1-af4c-78ea3dca9f81" released by "delete_volume" :: held 0.682s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-c9696729-b755-4686-9e11-943d794e83a0 tempest-AttachVolumeNegativeTest-1875054094 None] Created reservations ['e706e0ac-2b86-478a-ba1d-3aac355b3d4e', '9a4b1f25-b4c9-48de-a8b7-0d479e965a1c', 'd6b6edae-ce3e-4bdf-941f-79ea2167f8af', '156b2703-ebd6-4934-b403-b62da552b29c'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c9696729-b755-4686-9e11-943d794e83a0 tempest-AttachVolumeNegativeTest-1875054094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c9696729-b755-4686-9e11-943d794e83a0 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c9696729-b755-4686-9e11-943d794e83a0 tempest-AttachVolumeNegativeTest-1875054094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c9696729-b755-4686-9e11-943d794e83a0 tempest-AttachVolumeNegativeTest-1875054094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c9696729-b755-4686-9e11-943d794e83a0 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c9696729-b755-4686-9e11-943d794e83a0 tempest-AttachVolumeNegativeTest-1875054094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:05 devstack sudo[97600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:45:05 devstack sudo[97600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:05 devstack sudo[97600]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c9696729-b755-4686-9e11-943d794e83a0 tempest-AttachVolumeNegativeTest-1875054094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.280s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-c9696729-b755-4686-9e11-943d794e83a0 tempest-AttachVolumeNegativeTest-1875054094 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:45:05 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-c9696729-b755-4686-9e11-943d794e83a0 tempest-AttachVolumeNegativeTest-1875054094 None] Deleted volume successfully. Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c9696729-b755-4686-9e11-943d794e83a0 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "cinder-63b3b4b7-fbd9-4ec1-af4c-78ea3dca9f81-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-63b86192-4164-4cf7-abf1-f5b3bb2610d3 tempest-AttachVolumeNegativeTest-1875054094 None] Acquiring lock "cinder-15f7c736-277e-4e2f-853a-edf07815909e-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-63b86192-4164-4cf7-abf1-f5b3bb2610d3 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "cinder-15f7c736-277e-4e2f-853a-edf07815909e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-63b86192-4164-4cf7-abf1-f5b3bb2610d3 tempest-AttachVolumeNegativeTest-1875054094 None] Acquiring lock "cinder-quobyte-15f7c736-277e-4e2f-853a-edf07815909e" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-63b86192-4164-4cf7-abf1-f5b3bb2610d3 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "cinder-quobyte-15f7c736-277e-4e2f-853a-edf07815909e" acquired by "delete_volume" :: waited 0.029s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e741137-0423-4b2b-bd1d-38eaf63c05b8]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-63b86192-4164-4cf7-abf1-f5b3bb2610d3 tempest-AttachVolumeNegativeTest-1875054094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-15f7c736-277e-4e2f-853a-edf07815909e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Flow 'volume_create_manager' (380e6d19-88e3-41c8-8346-a2e567dcd358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28afcd7f-9399-48b9-b68b-555b6b325724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28afcd7f-9399-48b9-b68b-555b6b325724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-200050914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93073ad5-cfc5-4ae9-98a4-d57a5a3da88b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4419a83cc2a4b2c94682025b3c37207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:45:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=5a2ba6f6-fb5e-423a-b5cd-78ba097210b9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:45:06Z,use_quota=True,user_id='4fda6d98187549b8ab0c2d701dfe5fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d07b06c-4af7-4c9f-a88a-bd9cb32ce7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d07b06c-4af7-4c9f-a88a-bd9cb32ce7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:05 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-15f7c736-277e-4e2f-853a-edf07815909e Jul 17 19:45:05 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1ea623-41b6-4ca7-8db5-74a5761ad770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1ea623-41b6-4ca7-8db5-74a5761ad770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '93073ad5-cfc5-4ae9-98a4-d57a5a3da88b', 'volume_name': 'volume-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b', 'volume_size': 2, 'snapshot_id': '5a2ba6f6-fb5e-423a-b5cd-78ba097210b9'}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddec5993-eb2c-4265-bc11-85582e36dfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddec5993-eb2c-4265-bc11-85582e36dfbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d01b9af6-4ee0-427a-b82b-e0aa14e2eb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:05 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Volume 93073ad5-cfc5-4ae9-98a4-d57a5a3da88b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b', 'volume_size': 2, 'snapshot_id': '5a2ba6f6-fb5e-423a-b5cd-78ba097210b9'} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "cinder-quobyte-5a2ba6f6-fb5e-423a-b5cd-78ba097210b9-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b" by "_create_volume_from_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-quobyte-5a2ba6f6-fb5e-423a-b5cd-78ba097210b9-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Creating volume 93073ad5-cfc5-4ae9-98a4-d57a5a3da88b from snapshot 5a2ba6f6-fb5e-423a-b5cd-78ba097210b9 {{(pid=87726) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "cinder-quobyte-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b" by "_copy_volume_from_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-quobyte-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] snapshot: 5a2ba6f6-fb5e-423a-b5cd-78ba097210b9, volume: 93073ad5-cfc5-4ae9-98a4-d57a5a3da88b, {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:45:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:06 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed65b266-9975-4db4-86eb-6a9744502d44]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303.5a2ba6f6-fb5e-423a-b5cd-78ba097210b9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:06 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303.5a2ba6f6-fb5e-423a-b5cd-78ba097210b9 Jul 17 19:45:06 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:06 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-63b86192-4164-4cf7-abf1-f5b3bb2610d3 tempest-AttachVolumeNegativeTest-1875054094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-15f7c736-277e-4e2f-853a-edf07815909e" returned: 0 in 0.395s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-63b86192-4164-4cf7-abf1-f5b3bb2610d3 tempest-AttachVolumeNegativeTest-1875054094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-15f7c736-277e-4e2f-853a-edf07815909e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:06 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-15f7c736-277e-4e2f-853a-edf07815909e Jul 17 19:45:06 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:06 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303.5a2ba6f6-fb5e-423a-b5cd-78ba097210b9" returned: 0 in 0.405s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:06 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82fa3b75-8dca-40fa-928b-7fd402a55303(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:45:06 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303 {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 19:45:06 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Creating direct copy from snapshot {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 19:45:06 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-63b86192-4164-4cf7-abf1-f5b3bb2610d3 tempest-AttachVolumeNegativeTest-1875054094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-15f7c736-277e-4e2f-853a-edf07815909e" returned: 0 in 0.266s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:06 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2b7f89-d065-439a-b1c0-fe1f60ec7250]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:06 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-63b86192-4164-4cf7-abf1-f5b3bb2610d3 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "cinder-quobyte-15f7c736-277e-4e2f-853a-edf07815909e" released by "delete_volume" :: held 0.726s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:06 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-63b86192-4164-4cf7-abf1-f5b3bb2610d3 tempest-AttachVolumeNegativeTest-1875054094 None] Created reservations ['3c61ccf5-a399-4495-ba8f-a83bcf302b14', '08bc562c-35bb-46cc-be27-bc2d30edb2de', '0dbf5d91-fe81-4b97-86f4-7f7ae86ee659', '29e902b2-599b-4276-a2a5-16b4f3e2c083'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:45:06 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303 Jul 17 19:45:06 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-63b86192-4164-4cf7-abf1-f5b3bb2610d3 tempest-AttachVolumeNegativeTest-1875054094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-63b86192-4164-4cf7-abf1-f5b3bb2610d3 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:06 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-63b86192-4164-4cf7-abf1-f5b3bb2610d3 tempest-AttachVolumeNegativeTest-1875054094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:45:06 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-63b86192-4164-4cf7-abf1-f5b3bb2610d3 tempest-AttachVolumeNegativeTest-1875054094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:45:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-63b86192-4164-4cf7-abf1-f5b3bb2610d3 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-63b86192-4164-4cf7-abf1-f5b3bb2610d3 tempest-AttachVolumeNegativeTest-1875054094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:06 devstack sudo[97619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:45:06 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:06 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-63b86192-4164-4cf7-abf1-f5b3bb2610d3 tempest-AttachVolumeNegativeTest-1875054094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.299s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:06 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-63b86192-4164-4cf7-abf1-f5b3bb2610d3 tempest-AttachVolumeNegativeTest-1875054094 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:45:06 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-63b86192-4164-4cf7-abf1-f5b3bb2610d3 tempest-AttachVolumeNegativeTest-1875054094 None] Deleted volume successfully. Jul 17 19:45:06 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303" returned: 0 in 0.481s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:06 devstack cinder-volume[87726]: DEBUG cinder.utils [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Path /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b not found in is_blk_device check {{(pid=87726) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 19:45:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:06 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b Jul 17 19:45:06 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-63b86192-4164-4cf7-abf1-f5b3bb2610d3 tempest-AttachVolumeNegativeTest-1875054094 None] Lock "cinder-15f7c736-277e-4e2f-853a-edf07815909e-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:06 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:12 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b" returned: 0 in 5.452s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:12 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a8d670-aba3-4928-8e5b-748ce2448c9c]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:12 devstack sudo[97640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303 Jul 17 19:45:12 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:12 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303" returned: 0 in 0.569s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:12 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Image conversion details: src /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303, size 1024.00 MB, duration 5.45 sec, destination /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b {{(pid=87726) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 19:45:12 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Converted 1024.00 MB image at 187.79 MB/s Jul 17 19:45:12 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b is being set with open permissions: ugo+rw Jul 17 19:45:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:12 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b Jul 17 19:45:12 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:13 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b" returned: 0 in 0.397s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-quobyte-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b" released by "_copy_volume_from_snapshot" :: held 7.415s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-quobyte-5a2ba6f6-fb5e-423a-b5cd-78ba097210b9-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b" released by "_create_volume_from_snapshot" :: held 7.452s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.468s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d01b9af6-4ee0-427a-b82b-e0aa14e2eb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b', 'volume_size': 2, 'snapshot_id': '5a2ba6f6-fb5e-423a-b5cd-78ba097210b9'}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f006e40-bbb3-419c-b415-50fd69a3ecce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:13 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Volume volume-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b (93073ad5-cfc5-4ae9-98a4-d57a5a3da88b): created successfully Jul 17 19:45:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f006e40-bbb3-419c-b415-50fd69a3ecce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Flow 'volume_create_manager' (380e6d19-88e3-41c8-8346-a2e567dcd358) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:45:13 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-a3d0dfda-e2ef-4a44-a2bb-e576d41baa4a tempest-VolumesSnapshotTestJSON-1650241216 None] Created volume successfully. Jul 17 19:45:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6ea8f0ff-6b69-417a-8fa0-c38442ccc79c tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "cinder-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6ea8f0ff-6b69-417a-8fa0-c38442ccc79c tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6ea8f0ff-6b69-417a-8fa0-c38442ccc79c tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "cinder-quobyte-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6ea8f0ff-6b69-417a-8fa0-c38442ccc79c tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-quobyte-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b" acquired by "delete_volume" :: waited 0.016s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:13 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ade5fd-20dc-4554-a7ab-47bcddebeba2]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6ea8f0ff-6b69-417a-8fa0-c38442ccc79c tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:13 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b Jul 17 19:45:13 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:14 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6ea8f0ff-6b69-417a-8fa0-c38442ccc79c tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b" returned: 0 in 0.464s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6ea8f0ff-6b69-417a-8fa0-c38442ccc79c tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:14 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b Jul 17 19:45:14 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:14 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6ea8f0ff-6b69-417a-8fa0-c38442ccc79c tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b" returned: 0 in 0.355s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:14 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6ea8f0ff-6b69-417a-8fa0-c38442ccc79c tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-quobyte-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b" released by "delete_volume" :: held 0.872s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:14 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-6ea8f0ff-6b69-417a-8fa0-c38442ccc79c tempest-VolumesSnapshotTestJSON-1650241216 None] Created reservations ['0233b394-4f70-44bf-973e-e882cf18947c', 'd148a9e3-6caf-4076-9fb5-21e1f0d8512a', 'bb2f5697-b0de-4594-8ea3-eb5b6786be8e', '94e87287-9e47-4de5-8623-6e18aed7bad8'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:45:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6ea8f0ff-6b69-417a-8fa0-c38442ccc79c tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6ea8f0ff-6b69-417a-8fa0-c38442ccc79c tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:14 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6ea8f0ff-6b69-417a-8fa0-c38442ccc79c tempest-VolumesSnapshotTestJSON-1650241216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:45:14 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6ea8f0ff-6b69-417a-8fa0-c38442ccc79c tempest-VolumesSnapshotTestJSON-1650241216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:45:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6ea8f0ff-6b69-417a-8fa0-c38442ccc79c tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6ea8f0ff-6b69-417a-8fa0-c38442ccc79c tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:14 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:45:14 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:14 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f8901fb9-85af-4cf3-b679-bf8a7085737b tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "cinder-5a2ba6f6-fb5e-423a-b5cd-78ba097210b9-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f8901fb9-85af-4cf3-b679-bf8a7085737b tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-5a2ba6f6-fb5e-423a-b5cd-78ba097210b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f8901fb9-85af-4cf3-b679-bf8a7085737b tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "cinder-quobyte-82fa3b75-8dca-40fa-928b-7fd402a55303" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f8901fb9-85af-4cf3-b679-bf8a7085737b tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-quobyte-82fa3b75-8dca-40fa-928b-7fd402a55303" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f8901fb9-85af-4cf3-b679-bf8a7085737b tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "cinder-quobyte-5a2ba6f6-fb5e-423a-b5cd-78ba097210b9" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f8901fb9-85af-4cf3-b679-bf8a7085737b tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-quobyte-5a2ba6f6-fb5e-423a-b5cd-78ba097210b9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-f8901fb9-85af-4cf3-b679-bf8a7085737b tempest-VolumesSnapshotTestJSON-1650241216 None] Deleting offline snapshot 5a2ba6f6-fb5e-423a-b5cd-78ba097210b9 of volume 82fa3b75-8dca-40fa-928b-7fd402a55303 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-f8901fb9-85af-4cf3-b679-bf8a7085737b tempest-VolumesSnapshotTestJSON-1650241216 None] snapshot_file for this snap is: volume-82fa3b75-8dca-40fa-928b-7fd402a55303.5a2ba6f6-fb5e-423a-b5cd-78ba097210b9 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9233c6-c2db-4b4a-ab78-44568744b193]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f8901fb9-85af-4cf3-b679-bf8a7085737b tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303.5a2ba6f6-fb5e-423a-b5cd-78ba097210b9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:15 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6ea8f0ff-6b69-417a-8fa0-c38442ccc79c tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.325s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-6ea8f0ff-6b69-417a-8fa0-c38442ccc79c tempest-VolumesSnapshotTestJSON-1650241216 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:45:15 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-6ea8f0ff-6b69-417a-8fa0-c38442ccc79c tempest-VolumesSnapshotTestJSON-1650241216 None] Deleted volume successfully. Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6ea8f0ff-6b69-417a-8fa0-c38442ccc79c tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-93073ad5-cfc5-4ae9-98a4-d57a5a3da88b-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:15 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303.5a2ba6f6-fb5e-423a-b5cd-78ba097210b9 Jul 17 19:45:15 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:15 devstack sudo[97664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:45:15 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] Flow 'volume_create_manager' (b6b18aa6-690a-4d76-b9d8-ea3904f8b7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608374bd-bf3c-4d75-b381-4bf4825a63be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608374bd-bf3c-4d75-b381-4bf4825a63be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-482732532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e88016-e75c-4e89-8de7-11aca84188fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d038d8a54a422e9907fb68a1f2c137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:45:15Z,use_quota=True,user_id='99cd78cf84fc4929be8a0e587507de81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (007dfa93-2963-4a7d-a12f-06d937714090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (007dfa93-2963-4a7d-a12f-06d937714090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65507b61-55ee-4de7-a5e6-77b30cd76bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65507b61-55ee-4de7-a5e6-77b30cd76bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17e88016-e75c-4e89-8de7-11aca84188fc', 'volume_name': 'volume-17e88016-e75c-4e89-8de7-11aca84188fc', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (910f29db-218a-473a-8f19-9bc4e4e7d744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (910f29db-218a-473a-8f19-9bc4e4e7d744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3d9d57-bb67-46e8-b4d9-0198c963899c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:15 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] Volume 17e88016-e75c-4e89-8de7-11aca84188fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17e88016-e75c-4e89-8de7-11aca84188fc', 'volume_size': 1} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-482732532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e88016-e75c-4e89-8de7-11aca84188fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d038d8a54a422e9907fb68a1f2c137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:45:15Z,use_quota=True,user_id='99cd78cf84fc4929be8a0e587507de81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] Creating volume 17e88016-e75c-4e89-8de7-11aca84188fc {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:45:15 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:15 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f8901fb9-85af-4cf3-b679-bf8a7085737b tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303.5a2ba6f6-fb5e-423a-b5cd-78ba097210b9" returned: 0 in 0.506s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-f8901fb9-85af-4cf3-b679-bf8a7085737b tempest-VolumesSnapshotTestJSON-1650241216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82fa3b75-8dca-40fa-928b-7fd402a55303(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:45:15 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc 1073741824 Jul 17 19:45:15 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb0a364-f43c-4bc2-894d-17bc64e35d91]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f8901fb9-85af-4cf3-b679-bf8a7085737b tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:15 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.375s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager._thread_info {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread count: 28 {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 19:45:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread info: [<_MainThread(MainThread, started 130066227544192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 19:45:15 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303 Jul 17 19:45:15 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:16 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f8901fb9-85af-4cf3-b679-bf8a7085737b tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303" returned: 0 in 0.402s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f8901fb9-85af-4cf3-b679-bf8a7085737b tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303.5a2ba6f6-fb5e-423a-b5cd-78ba097210b9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:16 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc 1073741824" returned: 0 in 0.486s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:16 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303.5a2ba6f6-fb5e-423a-b5cd-78ba097210b9 Jul 17 19:45:16 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:16 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc Jul 17 19:45:16 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:16 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc" returned: 0 in 0.291s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:16 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:45:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3d9d57-bb67-46e8-b4d9-0198c963899c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17e88016-e75c-4e89-8de7-11aca84188fc', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbdaa601-cabf-4db9-89d0-fbc3f2dde5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:16 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] Volume volume-17e88016-e75c-4e89-8de7-11aca84188fc (17e88016-e75c-4e89-8de7-11aca84188fc): created successfully Jul 17 19:45:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbdaa601-cabf-4db9-89d0-fbc3f2dde5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] Flow 'volume_create_manager' (b6b18aa6-690a-4d76-b9d8-ea3904f8b7f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:45:16 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-ded745cb-21a8-4e7c-839f-067441ea8572 tempest-SnapshotsActionsTest-495057273 None] Created volume successfully. Jul 17 19:45:16 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f8901fb9-85af-4cf3-b679-bf8a7085737b tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303.5a2ba6f6-fb5e-423a-b5cd-78ba097210b9" returned: 0 in 0.418s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f8901fb9-85af-4cf3-b679-bf8a7085737b tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303.5a2ba6f6-fb5e-423a-b5cd-78ba097210b9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:16 devstack sudo[97689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303.5a2ba6f6-fb5e-423a-b5cd-78ba097210b9 Jul 17 19:45:16 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:16 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f8901fb9-85af-4cf3-b679-bf8a7085737b tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303.5a2ba6f6-fb5e-423a-b5cd-78ba097210b9" returned: 0 in 0.260s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f8901fb9-85af-4cf3-b679-bf8a7085737b tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-quobyte-5a2ba6f6-fb5e-423a-b5cd-78ba097210b9" released by "_delete_snapshot" :: held 1.718s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f8901fb9-85af-4cf3-b679-bf8a7085737b tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-quobyte-82fa3b75-8dca-40fa-928b-7fd402a55303" released by "delete_snapshot" :: held 1.743s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:16 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-f8901fb9-85af-4cf3-b679-bf8a7085737b tempest-VolumesSnapshotTestJSON-1650241216 None] Created reservations ['efc745f1-3083-409a-80be-31029547d4eb', 'a76e08e0-bae1-4d26-88ad-4f73d52d6dd1', '518c9a7b-10eb-4279-93c6-b00bb18b5c0a', 'bc4d184f-f034-4192-96c6-c27d231f7da9'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:45:16 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-f8901fb9-85af-4cf3-b679-bf8a7085737b tempest-VolumesSnapshotTestJSON-1650241216 None] Delete snapshot completed successfully. Jul 17 19:45:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f8901fb9-85af-4cf3-b679-bf8a7085737b tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-5a2ba6f6-fb5e-423a-b5cd-78ba097210b9-delete_snapshot" released by "delete_snapshot" :: held 1.907s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:17 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ffdecff7-aef5-4ccf-964e-cfc3238bea65 tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "cinder-82fa3b75-8dca-40fa-928b-7fd402a55303-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:17 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ffdecff7-aef5-4ccf-964e-cfc3238bea65 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-82fa3b75-8dca-40fa-928b-7fd402a55303-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:17 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ffdecff7-aef5-4ccf-964e-cfc3238bea65 tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "cinder-quobyte-82fa3b75-8dca-40fa-928b-7fd402a55303" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:17 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ffdecff7-aef5-4ccf-964e-cfc3238bea65 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-quobyte-82fa3b75-8dca-40fa-928b-7fd402a55303" acquired by "delete_volume" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:17 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ff7831-4368-4d61-aa66-84127f030949]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ffdecff7-aef5-4ccf-964e-cfc3238bea65 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:17 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303 Jul 17 19:45:17 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f40d3ba9-74a2-4d23-9ff9-0d34da2008e7 tempest-SnapshotsActionsTest-495057273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f40d3ba9-74a2-4d23-9ff9-0d34da2008e7 tempest-SnapshotsActionsTest-495057273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:17 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-f40d3ba9-74a2-4d23-9ff9-0d34da2008e7 tempest-SnapshotsActionsTest-495057273 None] Creating offline snapshot 1e2462e2-fd87-48c1-bdd9-82a833ed8e9e of volume 17e88016-e75c-4e89-8de7-11aca84188fc {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:45:17 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff26e14c-b23d-4bd6-bc3c-219481f507ba]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f40d3ba9-74a2-4d23-9ff9-0d34da2008e7 tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:17 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ffdecff7-aef5-4ccf-964e-cfc3238bea65 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303" returned: 0 in 0.404s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ffdecff7-aef5-4ccf-964e-cfc3238bea65 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:17 devstack sudo[97698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303 Jul 17 19:45:17 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:17 devstack sudo[97697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc Jul 17 19:45:17 devstack sudo[97697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:18 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ffdecff7-aef5-4ccf-964e-cfc3238bea65 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82fa3b75-8dca-40fa-928b-7fd402a55303" returned: 0 in 0.263s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ffdecff7-aef5-4ccf-964e-cfc3238bea65 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-quobyte-82fa3b75-8dca-40fa-928b-7fd402a55303" released by "delete_volume" :: held 0.743s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-ffdecff7-aef5-4ccf-964e-cfc3238bea65 tempest-VolumesSnapshotTestJSON-1650241216 None] Created reservations ['e15764b2-afff-48bc-9aca-59e4f2727962', 'c32d4265-fdf9-4c3d-aaa7-0199ce17a0dc', '23c5d48d-a652-46ae-904e-095acf6855a8', '9acd3935-629d-4a79-ba07-193b97105b31'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:45:18 devstack sudo[97697]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f40d3ba9-74a2-4d23-9ff9-0d34da2008e7 tempest-SnapshotsActionsTest-495057273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc" returned: 0 in 0.434s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f40d3ba9-74a2-4d23-9ff9-0d34da2008e7 tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:18 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e 1G Jul 17 19:45:18 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ffdecff7-aef5-4ccf-964e-cfc3238bea65 tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ffdecff7-aef5-4ccf-964e-cfc3238bea65 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ffdecff7-aef5-4ccf-964e-cfc3238bea65 tempest-VolumesSnapshotTestJSON-1650241216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ffdecff7-aef5-4ccf-964e-cfc3238bea65 tempest-VolumesSnapshotTestJSON-1650241216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ffdecff7-aef5-4ccf-964e-cfc3238bea65 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ffdecff7-aef5-4ccf-964e-cfc3238bea65 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:18 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:45:18 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] Flow 'volume_create_manager' (619542fc-fdda-43c5-9733-01565df16546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c7ed72-4341-48f0-8223-fc10b1ee0f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c7ed72-4341-48f0-8223-fc10b1ee0f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-782439981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c40bd7a-faf2-4b1f-8636-538833dccab3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='05fd989b69654eea9cf290da0938e6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:45:18Z,use_quota=True,user_id='3115c83d1efe4f0c8436f0df4b647726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89ab9575-729a-48a7-868b-c65a7f1f486d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89ab9575-729a-48a7-868b-c65a7f1f486d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3a7d159-1991-4df7-be2a-846955094413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3a7d159-1991-4df7-be2a-846955094413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c40bd7a-faf2-4b1f-8636-538833dccab3', 'volume_name': 'volume-1c40bd7a-faf2-4b1f-8636-538833dccab3', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (133aecad-3f90-420e-b697-f43a8303f2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (133aecad-3f90-420e-b697-f43a8303f2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad37a99-ed50-4a79-bcac-c2399a88fb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:18 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] Volume 1c40bd7a-faf2-4b1f-8636-538833dccab3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c40bd7a-faf2-4b1f-8636-538833dccab3', 'volume_size': 1} Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:18 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ffdecff7-aef5-4ccf-964e-cfc3238bea65 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.293s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-ffdecff7-aef5-4ccf-964e-cfc3238bea65 tempest-VolumesSnapshotTestJSON-1650241216 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:45:18 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-ffdecff7-aef5-4ccf-964e-cfc3238bea65 tempest-VolumesSnapshotTestJSON-1650241216 None] Deleted volume successfully. Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ffdecff7-aef5-4ccf-964e-cfc3238bea65 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-82fa3b75-8dca-40fa-928b-7fd402a55303-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:18 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f40d3ba9-74a2-4d23-9ff9-0d34da2008e7 tempest-SnapshotsActionsTest-495057273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e 1G" returned: 0 in 0.461s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f40d3ba9-74a2-4d23-9ff9-0d34da2008e7 tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e88016-e75c-4e89-8de7-11aca84188fc -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:18 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e88016-e75c-4e89-8de7-11aca84188fc -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e Jul 17 19:45:18 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:18 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f40d3ba9-74a2-4d23-9ff9-0d34da2008e7 tempest-SnapshotsActionsTest-495057273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e88016-e75c-4e89-8de7-11aca84188fc -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e" returned: 0 in 0.293s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:18 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-f40d3ba9-74a2-4d23-9ff9-0d34da2008e7 tempest-SnapshotsActionsTest-495057273 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e is being set with open permissions: ugo+rw Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f40d3ba9-74a2-4d23-9ff9-0d34da2008e7 tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:18 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e Jul 17 19:45:18 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:18 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:45:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] Flow 'volume_create_manager' (23ac25d8-b5d2-4626-aa84-bea9c9ce4fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:45:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19e5f0c8-1df7-44d6-9e40-e1572b946b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19e5f0c8-1df7-44d6-9e40-e1572b946b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-707017194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef442927-2f2f-4ac8-8940-ba5cff1ec2a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4419a83cc2a4b2c94682025b3c37207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:45:19Z,use_quota=True,user_id='4fda6d98187549b8ab0c2d701dfe5fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3754a167-1fbc-41a8-9db4-9870feb1aaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3754a167-1fbc-41a8-9db4-9870feb1aaaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d98c3a-4511-481d-ba55-b07b3d19891b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d98c3a-4511-481d-ba55-b07b3d19891b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef442927-2f2f-4ac8-8940-ba5cff1ec2a1', 'volume_name': 'volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb4ef20-c538-4d58-9ba0-8e57be222600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb4ef20-c538-4d58-9ba0-8e57be222600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04860e8c-7446-44a5-a8b4-b03a0d6b4cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:19 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] Volume ef442927-2f2f-4ac8-8940-ba5cff1ec2a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1', 'volume_size': 1} Jul 17 19:45:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:19 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f40d3ba9-74a2-4d23-9ff9-0d34da2008e7 tempest-SnapshotsActionsTest-495057273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e" returned: 0 in 0.235s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f40d3ba9-74a2-4d23-9ff9-0d34da2008e7 tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:19 devstack sudo[97722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.info Jul 17 19:45:19 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:19 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f40d3ba9-74a2-4d23-9ff9-0d34da2008e7 tempest-SnapshotsActionsTest-495057273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.info" returned: 0 in 0.261s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:19 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-f40d3ba9-74a2-4d23-9ff9-0d34da2008e7 tempest-SnapshotsActionsTest-495057273 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.info is being set with open permissions: ugo+rw Jul 17 19:45:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f40d3ba9-74a2-4d23-9ff9-0d34da2008e7 tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:19 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.info Jul 17 19:45:19 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:19 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f40d3ba9-74a2-4d23-9ff9-0d34da2008e7 tempest-SnapshotsActionsTest-495057273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.info" returned: 0 in 0.242s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f40d3ba9-74a2-4d23-9ff9-0d34da2008e7 tempest-SnapshotsActionsTest-495057273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.015s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.335s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:19 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-782439981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c40bd7a-faf2-4b1f-8636-538833dccab3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='05fd989b69654eea9cf290da0938e6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:45:18Z,use_quota=True,user_id='3115c83d1efe4f0c8436f0df4b647726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:45:19 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] Creating volume 1c40bd7a-faf2-4b1f-8636-538833dccab3 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:45:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:19 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:45:19 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:45:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:19 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:45:19 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:45:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1c40bd7a-faf2-4b1f-8636-538833dccab3 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:19 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1c40bd7a-faf2-4b1f-8636-538833dccab3 1073741824 Jul 17 19:45:19 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:19 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-f40d3ba9-74a2-4d23-9ff9-0d34da2008e7 tempest-SnapshotsActionsTest-495057273 None] Create snapshot completed successfully Jul 17 19:45:20 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1c40bd7a-faf2-4b1f-8636-538833dccab3 1073741824" returned: 0 in 0.399s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1c40bd7a-faf2-4b1f-8636-538833dccab3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:20 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1c40bd7a-faf2-4b1f-8636-538833dccab3 Jul 17 19:45:20 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:20 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1c40bd7a-faf2-4b1f-8636-538833dccab3" returned: 0 in 0.258s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:20 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:45:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.359s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:20 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-707017194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef442927-2f2f-4ac8-8940-ba5cff1ec2a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4419a83cc2a4b2c94682025b3c37207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:45:19Z,use_quota=True,user_id='4fda6d98187549b8ab0c2d701dfe5fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:45:20 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] Creating volume ef442927-2f2f-4ac8-8940-ba5cff1ec2a1 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:45:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:20 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:45:20 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:45:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:20 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:45:20 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:45:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:20 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad37a99-ed50-4a79-bcac-c2399a88fb0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c40bd7a-faf2-4b1f-8636-538833dccab3', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:20 devstack sudo[97737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1 1073741824 Jul 17 19:45:20 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:20 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b8686ee-c5be-4ac9-a961-98f36e6e4121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:20 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] Volume volume-1c40bd7a-faf2-4b1f-8636-538833dccab3 (1c40bd7a-faf2-4b1f-8636-538833dccab3): created successfully Jul 17 19:45:20 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b8686ee-c5be-4ac9-a961-98f36e6e4121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:20 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] Flow 'volume_create_manager' (619542fc-fdda-43c5-9733-01565df16546) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:45:20 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-350a45fd-23b6-4728-a13e-ab5592aca4b7 tempest-VolumesTestJSON-241033308 None] Created volume successfully. Jul 17 19:45:20 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1 1073741824" returned: 0 in 0.433s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:20 devstack sudo[97743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1 Jul 17 19:45:20 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:21 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1" returned: 0 in 0.237s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:45:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04860e8c-7446-44a5-a8b4-b03a0d6b4cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ecb9f6-3979-4159-8d12-16442ce3e034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:21 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] Volume volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1 (ef442927-2f2f-4ac8-8940-ba5cff1ec2a1): created successfully Jul 17 19:45:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ecb9f6-3979-4159-8d12-16442ce3e034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] Flow 'volume_create_manager' (23ac25d8-b5d2-4626-aa84-bea9c9ce4fb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:45:21 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-cf7ef6b6-daed-4a1f-bc7a-723d6ac66f61 tempest-VolumesSnapshotTestJSON-1650241216 None] Created volume successfully. Jul 17 19:45:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-dccacf1e-44a8-4ecb-9d67-e13bf8637343 tempest-SnapshotsActionsTest-495057273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-dccacf1e-44a8-4ecb-9d67-e13bf8637343 tempest-SnapshotsActionsTest-495057273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-dccacf1e-44a8-4ecb-9d67-e13bf8637343 tempest-SnapshotsActionsTest-495057273 None] Creating offline snapshot 6c4de7d0-8f83-457c-8dc6-602664c52730 of volume 17e88016-e75c-4e89-8de7-11aca84188fc {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:45:21 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb94404-5525-4bad-ac53-5d66a01fdb04]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dccacf1e-44a8-4ecb-9d67-e13bf8637343 tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:21 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e Jul 17 19:45:21 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:21 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dccacf1e-44a8-4ecb-9d67-e13bf8637343 tempest-SnapshotsActionsTest-495057273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e" returned: 0 in 0.408s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-dccacf1e-44a8-4ecb-9d67-e13bf8637343 tempest-SnapshotsActionsTest-495057273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17e88016-e75c-4e89-8de7-11aca84188fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:45:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dccacf1e-44a8-4ecb-9d67-e13bf8637343 tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.6c4de7d0-8f83-457c-8dc6-602664c52730 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:21 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.6c4de7d0-8f83-457c-8dc6-602664c52730 1G Jul 17 19:45:21 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:21 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:45:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] Flow 'volume_create_manager' (dd93bd7b-9f07-4f18-a284-4aa53d5fb61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:45:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5760498-15f4-4768-acf4-a9b77aaf3af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5760498-15f4-4768-acf4-a9b77aaf3af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1611301919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c96b6a8-428c-4f56-8dae-76805da0d810,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='05fd989b69654eea9cf290da0938e6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:45:22Z,use_quota=True,user_id='3115c83d1efe4f0c8436f0df4b647726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85bffb57-b85b-45a6-8efd-81c7bb76dae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85bffb57-b85b-45a6-8efd-81c7bb76dae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20e2452-5f2a-43fa-b543-e52a2bee73ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20e2452-5f2a-43fa-b543-e52a2bee73ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c96b6a8-428c-4f56-8dae-76805da0d810', 'volume_name': 'volume-5c96b6a8-428c-4f56-8dae-76805da0d810', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f45dc1-5a28-40c7-bf18-da477f3771f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f45dc1-5a28-40c7-bf18-da477f3771f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adfbd650-c1a5-4bcd-bf69-c3fb50bab1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:22 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] Volume 5c96b6a8-428c-4f56-8dae-76805da0d810: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c96b6a8-428c-4f56-8dae-76805da0d810', 'volume_size': 1} Jul 17 19:45:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:22 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dccacf1e-44a8-4ecb-9d67-e13bf8637343 tempest-SnapshotsActionsTest-495057273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.6c4de7d0-8f83-457c-8dc6-602664c52730 1G" returned: 0 in 0.434s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dccacf1e-44a8-4ecb-9d67-e13bf8637343 tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.6c4de7d0-8f83-457c-8dc6-602664c52730 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:22 devstack sudo[97757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.6c4de7d0-8f83-457c-8dc6-602664c52730 Jul 17 19:45:22 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f6081c49-312e-4801-a489-e8bcde098d85 tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:22 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dccacf1e-44a8-4ecb-9d67-e13bf8637343 tempest-SnapshotsActionsTest-495057273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.6c4de7d0-8f83-457c-8dc6-602664c52730" returned: 0 in 0.303s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:22 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-dccacf1e-44a8-4ecb-9d67-e13bf8637343 tempest-SnapshotsActionsTest-495057273 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.6c4de7d0-8f83-457c-8dc6-602664c52730 is being set with open permissions: ugo+rw Jul 17 19:45:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dccacf1e-44a8-4ecb-9d67-e13bf8637343 tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.6c4de7d0-8f83-457c-8dc6-602664c52730 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:22 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.6c4de7d0-8f83-457c-8dc6-602664c52730 Jul 17 19:45:22 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:22 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dccacf1e-44a8-4ecb-9d67-e13bf8637343 tempest-SnapshotsActionsTest-495057273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.6c4de7d0-8f83-457c-8dc6-602664c52730" returned: 0 in 0.237s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-dccacf1e-44a8-4ecb-9d67-e13bf8637343 tempest-SnapshotsActionsTest-495057273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.475s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.833s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1611301919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c96b6a8-428c-4f56-8dae-76805da0d810,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='05fd989b69654eea9cf290da0938e6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:45:22Z,use_quota=True,user_id='3115c83d1efe4f0c8436f0df4b647726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:45:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] Creating volume 5c96b6a8-428c-4f56-8dae-76805da0d810 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:45:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:45:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:45:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:45:22 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:45:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5c96b6a8-428c-4f56-8dae-76805da0d810 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:22 devstack sudo[97765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5c96b6a8-428c-4f56-8dae-76805da0d810 1073741824 Jul 17 19:45:22 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:22 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-dccacf1e-44a8-4ecb-9d67-e13bf8637343 tempest-SnapshotsActionsTest-495057273 None] Create snapshot completed successfully Jul 17 19:45:23 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5c96b6a8-428c-4f56-8dae-76805da0d810 1073741824" returned: 0 in 0.451s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5c96b6a8-428c-4f56-8dae-76805da0d810 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:23 devstack sudo[97770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5c96b6a8-428c-4f56-8dae-76805da0d810 Jul 17 19:45:23 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f654db71-c919-46e7-abc5-8de0cf18ae5d tempest-SnapshotsActionsTest-160643760 None] Acquiring lock "cinder-6c4de7d0-8f83-457c-8dc6-602664c52730-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:23 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5c96b6a8-428c-4f56-8dae-76805da0d810" returned: 0 in 0.259s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:45:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f6081c49-312e-4801-a489-e8bcde098d85 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.109s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f654db71-c919-46e7-abc5-8de0cf18ae5d tempest-SnapshotsActionsTest-160643760 None] Lock "cinder-6c4de7d0-8f83-457c-8dc6-602664c52730-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f654db71-c919-46e7-abc5-8de0cf18ae5d tempest-SnapshotsActionsTest-160643760 None] Acquiring lock "cinder-quobyte-17e88016-e75c-4e89-8de7-11aca84188fc" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-f6081c49-312e-4801-a489-e8bcde098d85 tempest-VolumesSnapshotTestJSON-1650241216 None] Creating offline snapshot 2b03563a-974b-4669-a533-de9c6250c12b of volume ef442927-2f2f-4ac8-8940-ba5cff1ec2a1 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:45:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adfbd650-c1a5-4bcd-bf69-c3fb50bab1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c96b6a8-428c-4f56-8dae-76805da0d810', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b64422-3b3e-438d-8148-2deeb65fdbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:23 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[134aecf9-bd86-425e-8e83-aeae8a7600f0]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f6081c49-312e-4801-a489-e8bcde098d85 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f654db71-c919-46e7-abc5-8de0cf18ae5d tempest-SnapshotsActionsTest-160643760 None] Lock "cinder-quobyte-17e88016-e75c-4e89-8de7-11aca84188fc" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f654db71-c919-46e7-abc5-8de0cf18ae5d tempest-SnapshotsActionsTest-160643760 None] Acquiring lock "cinder-quobyte-6c4de7d0-8f83-457c-8dc6-602664c52730" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:23 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] Volume volume-5c96b6a8-428c-4f56-8dae-76805da0d810 (5c96b6a8-428c-4f56-8dae-76805da0d810): created successfully Jul 17 19:45:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b64422-3b3e-438d-8148-2deeb65fdbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] Flow 'volume_create_manager' (dd93bd7b-9f07-4f18-a284-4aa53d5fb61b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:45:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f654db71-c919-46e7-abc5-8de0cf18ae5d tempest-SnapshotsActionsTest-160643760 None] Lock "cinder-quobyte-6c4de7d0-8f83-457c-8dc6-602664c52730" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-f654db71-c919-46e7-abc5-8de0cf18ae5d tempest-SnapshotsActionsTest-160643760 None] Deleting offline snapshot 6c4de7d0-8f83-457c-8dc6-602664c52730 of volume 17e88016-e75c-4e89-8de7-11aca84188fc {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:45:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-f654db71-c919-46e7-abc5-8de0cf18ae5d tempest-SnapshotsActionsTest-160643760 None] snapshot_file for this snap is: volume-17e88016-e75c-4e89-8de7-11aca84188fc.6c4de7d0-8f83-457c-8dc6-602664c52730 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:45:23 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-fb3ca07e-6ed6-414c-a26a-d410e6624c6e tempest-VolumesTestJSON-241033308 None] Created volume successfully. Jul 17 19:45:23 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d7e719-9741-49b3-b2cb-c49f8263e469]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f654db71-c919-46e7-abc5-8de0cf18ae5d tempest-SnapshotsActionsTest-160643760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.6c4de7d0-8f83-457c-8dc6-602664c52730 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:23 devstack sudo[97773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1 Jul 17 19:45:23 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:23 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.6c4de7d0-8f83-457c-8dc6-602664c52730 Jul 17 19:45:23 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:24 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f6081c49-312e-4801-a489-e8bcde098d85 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1" returned: 0 in 0.411s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f6081c49-312e-4801-a489-e8bcde098d85 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1.2b03563a-974b-4669-a533-de9c6250c12b 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:24 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1.2b03563a-974b-4669-a533-de9c6250c12b 1G Jul 17 19:45:24 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:24 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f654db71-c919-46e7-abc5-8de0cf18ae5d tempest-SnapshotsActionsTest-160643760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.6c4de7d0-8f83-457c-8dc6-602664c52730" returned: 0 in 0.392s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-f654db71-c919-46e7-abc5-8de0cf18ae5d tempest-SnapshotsActionsTest-160643760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17e88016-e75c-4e89-8de7-11aca84188fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:45:24 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[69dab591-3625-4ab5-b9e1-d51265e6df44]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f654db71-c919-46e7-abc5-8de0cf18ae5d tempest-SnapshotsActionsTest-160643760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:24 devstack sudo[97785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e Jul 17 19:45:24 devstack sudo[97785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:24 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f6081c49-312e-4801-a489-e8bcde098d85 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1.2b03563a-974b-4669-a533-de9c6250c12b 1G" returned: 0 in 0.494s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f6081c49-312e-4801-a489-e8bcde098d85 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1.2b03563a-974b-4669-a533-de9c6250c12b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:24 devstack sudo[97793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1.2b03563a-974b-4669-a533-de9c6250c12b Jul 17 19:45:24 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:24 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:45:24 devstack sudo[97785]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] Flow 'volume_create_manager' (83e28cda-7e35-4213-af72-2d30f3dd2468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:45:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c6af625-5ab9-4db5-9d3b-173e6cdd9fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f654db71-c919-46e7-abc5-8de0cf18ae5d tempest-SnapshotsActionsTest-160643760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e" returned: 0 in 0.493s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-f654db71-c919-46e7-abc5-8de0cf18ae5d tempest-SnapshotsActionsTest-160643760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17e88016-e75c-4e89-8de7-11aca84188fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:45:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f654db71-c919-46e7-abc5-8de0cf18ae5d tempest-SnapshotsActionsTest-160643760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.6c4de7d0-8f83-457c-8dc6-602664c52730 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:24 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.6c4de7d0-8f83-457c-8dc6-602664c52730 Jul 17 19:45:24 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c6af625-5ab9-4db5-9d3b-173e6cdd9fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-462423333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffab3db3-b1d4-4c55-8506-9ba460273ec8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='05fd989b69654eea9cf290da0938e6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:45:25Z,use_quota=True,user_id='3115c83d1efe4f0c8436f0df4b647726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d0131a8-93dd-4c42-bf31-85d0614c2e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d0131a8-93dd-4c42-bf31-85d0614c2e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f1ebd68-2bdf-49af-8574-bb20081fddd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f1ebd68-2bdf-49af-8574-bb20081fddd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffab3db3-b1d4-4c55-8506-9ba460273ec8', 'volume_name': 'volume-ffab3db3-b1d4-4c55-8506-9ba460273ec8', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8803c31f-8b0d-4c5f-ac1d-9b8e945fa9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8803c31f-8b0d-4c5f-ac1d-9b8e945fa9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be9515a-8174-4486-8275-a7f71b8eb3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:24 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] Volume ffab3db3-b1d4-4c55-8506-9ba460273ec8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffab3db3-b1d4-4c55-8506-9ba460273ec8', 'volume_size': 1} Jul 17 19:45:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:24 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f6081c49-312e-4801-a489-e8bcde098d85 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1.2b03563a-974b-4669-a533-de9c6250c12b" returned: 0 in 0.309s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:24 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-f6081c49-312e-4801-a489-e8bcde098d85 tempest-VolumesSnapshotTestJSON-1650241216 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1.2b03563a-974b-4669-a533-de9c6250c12b is being set with open permissions: ugo+rw Jul 17 19:45:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f6081c49-312e-4801-a489-e8bcde098d85 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1.2b03563a-974b-4669-a533-de9c6250c12b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:24 devstack sudo[97804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1.2b03563a-974b-4669-a533-de9c6250c12b Jul 17 19:45:24 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:25 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f654db71-c919-46e7-abc5-8de0cf18ae5d tempest-SnapshotsActionsTest-160643760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.6c4de7d0-8f83-457c-8dc6-602664c52730" returned: 0 in 0.362s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f654db71-c919-46e7-abc5-8de0cf18ae5d tempest-SnapshotsActionsTest-160643760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.6c4de7d0-8f83-457c-8dc6-602664c52730 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:25 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.6c4de7d0-8f83-457c-8dc6-602664c52730 Jul 17 19:45:25 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:25 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f6081c49-312e-4801-a489-e8bcde098d85 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1.2b03563a-974b-4669-a533-de9c6250c12b" returned: 0 in 0.252s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f6081c49-312e-4801-a489-e8bcde098d85 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:25 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1.info Jul 17 19:45:25 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:25 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f654db71-c919-46e7-abc5-8de0cf18ae5d tempest-SnapshotsActionsTest-160643760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.6c4de7d0-8f83-457c-8dc6-602664c52730" returned: 0 in 0.242s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:25 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f654db71-c919-46e7-abc5-8de0cf18ae5d tempest-SnapshotsActionsTest-160643760 None] Lock "cinder-quobyte-6c4de7d0-8f83-457c-8dc6-602664c52730" released by "_delete_snapshot" :: held 1.587s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:25 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f654db71-c919-46e7-abc5-8de0cf18ae5d tempest-SnapshotsActionsTest-160643760 None] Lock "cinder-quobyte-17e88016-e75c-4e89-8de7-11aca84188fc" released by "delete_snapshot" :: held 1.631s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:25 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-f654db71-c919-46e7-abc5-8de0cf18ae5d tempest-SnapshotsActionsTest-160643760 None] Created reservations ['d60ff6c1-229f-478e-926b-7f8512b0c83e', 'caa128c8-4dde-4d32-bf69-b3ae1f75aa17', 'f9d6189a-ff93-4c00-acf7-f0e6348ac242', '6a3088c2-449e-4056-8db8-d1c8eedabad4'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:45:25 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-f654db71-c919-46e7-abc5-8de0cf18ae5d tempest-SnapshotsActionsTest-160643760 None] Delete snapshot completed successfully. Jul 17 19:45:25 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f6081c49-312e-4801-a489-e8bcde098d85 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1.info" returned: 0 in 0.272s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:25 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-f6081c49-312e-4801-a489-e8bcde098d85 tempest-VolumesSnapshotTestJSON-1650241216 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1.info is being set with open permissions: ugo+rw Jul 17 19:45:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f6081c49-312e-4801-a489-e8bcde098d85 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:25 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f654db71-c919-46e7-abc5-8de0cf18ae5d tempest-SnapshotsActionsTest-160643760 None] Lock "cinder-6c4de7d0-8f83-457c-8dc6-602664c52730-delete_snapshot" released by "delete_snapshot" :: held 1.821s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:25 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1.info Jul 17 19:45:25 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:25 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f6081c49-312e-4801-a489-e8bcde098d85 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1.info" returned: 0 in 0.261s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f6081c49-312e-4801-a489-e8bcde098d85 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.099s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.947s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-462423333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffab3db3-b1d4-4c55-8506-9ba460273ec8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='05fd989b69654eea9cf290da0938e6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:45:25Z,use_quota=True,user_id='3115c83d1efe4f0c8436f0df4b647726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:45:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] Creating volume ffab3db3-b1d4-4c55-8506-9ba460273ec8 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:45:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:45:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:45:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:45:25 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:45:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ffab3db3-b1d4-4c55-8506-9ba460273ec8 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:25 devstack sudo[97818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ffab3db3-b1d4-4c55-8506-9ba460273ec8 1073741824 Jul 17 19:45:25 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:25 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-f6081c49-312e-4801-a489-e8bcde098d85 tempest-VolumesSnapshotTestJSON-1650241216 None] Create snapshot completed successfully Jul 17 19:45:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-57fd91a2-06a4-496a-a09d-59fd1e83168b tempest-SnapshotsActionsTest-495057273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:26 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ffab3db3-b1d4-4c55-8506-9ba460273ec8 1073741824" returned: 0 in 0.478s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ffab3db3-b1d4-4c55-8506-9ba460273ec8 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:26 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ffab3db3-b1d4-4c55-8506-9ba460273ec8 Jul 17 19:45:26 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:26 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ffab3db3-b1d4-4c55-8506-9ba460273ec8" returned: 0 in 0.251s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:26 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:45:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-57fd91a2-06a4-496a-a09d-59fd1e83168b tempest-SnapshotsActionsTest-495057273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.439s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be9515a-8174-4486-8275-a7f71b8eb3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffab3db3-b1d4-4c55-8506-9ba460273ec8', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9939a853-a840-4bb3-b8e5-39c23f90b7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:26 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-57fd91a2-06a4-496a-a09d-59fd1e83168b tempest-SnapshotsActionsTest-495057273 None] Creating offline snapshot 74da8bfc-d138-4fa3-adb5-5eaae0839df9 of volume 17e88016-e75c-4e89-8de7-11aca84188fc {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:45:26 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] Volume volume-ffab3db3-b1d4-4c55-8506-9ba460273ec8 (ffab3db3-b1d4-4c55-8506-9ba460273ec8): created successfully Jul 17 19:45:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9939a853-a840-4bb3-b8e5-39c23f90b7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] Flow 'volume_create_manager' (83e28cda-7e35-4213-af72-2d30f3dd2468) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:45:26 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[997a8c83-c2a4-42e6-b12c-a2a45bc3e94a]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-57fd91a2-06a4-496a-a09d-59fd1e83168b tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:26 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-9333f29d-5ad4-48f9-8dad-5706700af5e2 tempest-VolumesTestJSON-241033308 None] Created volume successfully. Jul 17 19:45:26 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e Jul 17 19:45:26 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:26 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-57fd91a2-06a4-496a-a09d-59fd1e83168b tempest-SnapshotsActionsTest-495057273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e" returned: 0 in 0.394s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:26 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-57fd91a2-06a4-496a-a09d-59fd1e83168b tempest-SnapshotsActionsTest-495057273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17e88016-e75c-4e89-8de7-11aca84188fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:45:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-57fd91a2-06a4-496a-a09d-59fd1e83168b tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.74da8bfc-d138-4fa3-adb5-5eaae0839df9 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:27 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.74da8bfc-d138-4fa3-adb5-5eaae0839df9 1G Jul 17 19:45:27 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:27 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:45:27 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Flow 'volume_create_manager' (981e43f2-5890-4395-8b92-7189c00b4edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:45:27 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54f9b2e-3f6f-4120-b451-5ea451cda6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:27 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54f9b2e-3f6f-4120-b451-5ea451cda6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-9596324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f258be91-1806-4541-8ce8-a0d95ce7d84d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4419a83cc2a4b2c94682025b3c37207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2b03563a-974b-4669-a533-de9c6250c12b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:45:27Z,use_quota=True,user_id='4fda6d98187549b8ab0c2d701dfe5fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:27 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5236237-a8ae-4e79-898b-3bbad1bf4e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:27 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5236237-a8ae-4e79-898b-3bbad1bf4e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:27 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc9a1f8f-5290-4199-aaf8-78a28aa12f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:27 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc9a1f8f-5290-4199-aaf8-78a28aa12f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f258be91-1806-4541-8ce8-a0d95ce7d84d', 'volume_name': 'volume-f258be91-1806-4541-8ce8-a0d95ce7d84d', 'volume_size': 1, 'snapshot_id': '2b03563a-974b-4669-a533-de9c6250c12b'}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:27 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (747d0475-c9dc-4432-9293-e8f26036332a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:27 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (747d0475-c9dc-4432-9293-e8f26036332a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:27 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c1e502-fb12-44ba-a9f2-4fd5a2b35566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:27 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Volume f258be91-1806-4541-8ce8-a0d95ce7d84d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f258be91-1806-4541-8ce8-a0d95ce7d84d', 'volume_size': 1, 'snapshot_id': '2b03563a-974b-4669-a533-de9c6250c12b'} Jul 17 19:45:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:27 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-57fd91a2-06a4-496a-a09d-59fd1e83168b tempest-SnapshotsActionsTest-495057273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.74da8bfc-d138-4fa3-adb5-5eaae0839df9 1G" returned: 0 in 0.434s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-57fd91a2-06a4-496a-a09d-59fd1e83168b tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.74da8bfc-d138-4fa3-adb5-5eaae0839df9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:27 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.74da8bfc-d138-4fa3-adb5-5eaae0839df9 Jul 17 19:45:27 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:27 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-57fd91a2-06a4-496a-a09d-59fd1e83168b tempest-SnapshotsActionsTest-495057273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.74da8bfc-d138-4fa3-adb5-5eaae0839df9" returned: 0 in 0.297s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:27 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-57fd91a2-06a4-496a-a09d-59fd1e83168b tempest-SnapshotsActionsTest-495057273 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.74da8bfc-d138-4fa3-adb5-5eaae0839df9 is being set with open permissions: ugo+rw Jul 17 19:45:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-57fd91a2-06a4-496a-a09d-59fd1e83168b tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.74da8bfc-d138-4fa3-adb5-5eaae0839df9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:27 devstack sudo[97842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.74da8bfc-d138-4fa3-adb5-5eaae0839df9 Jul 17 19:45:27 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:27 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-57fd91a2-06a4-496a-a09d-59fd1e83168b tempest-SnapshotsActionsTest-495057273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.74da8bfc-d138-4fa3-adb5-5eaae0839df9" returned: 0 in 0.242s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-57fd91a2-06a4-496a-a09d-59fd1e83168b tempest-SnapshotsActionsTest-495057273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.502s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.667s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "cinder-quobyte-2b03563a-974b-4669-a533-de9c6250c12b-f258be91-1806-4541-8ce8-a0d95ce7d84d" by "_create_volume_from_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-quobyte-2b03563a-974b-4669-a533-de9c6250c12b-f258be91-1806-4541-8ce8-a0d95ce7d84d" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Creating volume f258be91-1806-4541-8ce8-a0d95ce7d84d from snapshot 2b03563a-974b-4669-a533-de9c6250c12b {{(pid=87726) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "cinder-quobyte-f258be91-1806-4541-8ce8-a0d95ce7d84d" by "_copy_volume_from_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:28 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-57fd91a2-06a4-496a-a09d-59fd1e83168b tempest-SnapshotsActionsTest-495057273 None] Create snapshot completed successfully Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-quobyte-f258be91-1806-4541-8ce8-a0d95ce7d84d" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] snapshot: 2b03563a-974b-4669-a533-de9c6250c12b, volume: f258be91-1806-4541-8ce8-a0d95ce7d84d, {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbab788-3f95-4b8d-83a7-14f46a773027]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1.2b03563a-974b-4669-a533-de9c6250c12b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:28 devstack sudo[97845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1.2b03563a-974b-4669-a533-de9c6250c12b Jul 17 19:45:28 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-fc4afbe4-e74e-4457-8982-482fe3d8317f tempest-SnapshotsActionsTest-160643760 None] Acquiring lock "cinder-74da8bfc-d138-4fa3-adb5-5eaae0839df9-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-fc4afbe4-e74e-4457-8982-482fe3d8317f tempest-SnapshotsActionsTest-160643760 None] Lock "cinder-74da8bfc-d138-4fa3-adb5-5eaae0839df9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-fc4afbe4-e74e-4457-8982-482fe3d8317f tempest-SnapshotsActionsTest-160643760 None] Acquiring lock "cinder-quobyte-17e88016-e75c-4e89-8de7-11aca84188fc" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-fc4afbe4-e74e-4457-8982-482fe3d8317f tempest-SnapshotsActionsTest-160643760 None] Lock "cinder-quobyte-17e88016-e75c-4e89-8de7-11aca84188fc" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-fc4afbe4-e74e-4457-8982-482fe3d8317f tempest-SnapshotsActionsTest-160643760 None] Acquiring lock "cinder-quobyte-74da8bfc-d138-4fa3-adb5-5eaae0839df9" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-fc4afbe4-e74e-4457-8982-482fe3d8317f tempest-SnapshotsActionsTest-160643760 None] Lock "cinder-quobyte-74da8bfc-d138-4fa3-adb5-5eaae0839df9" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-fc4afbe4-e74e-4457-8982-482fe3d8317f tempest-SnapshotsActionsTest-160643760 None] Deleting offline snapshot 74da8bfc-d138-4fa3-adb5-5eaae0839df9 of volume 17e88016-e75c-4e89-8de7-11aca84188fc {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-fc4afbe4-e74e-4457-8982-482fe3d8317f tempest-SnapshotsActionsTest-160643760 None] snapshot_file for this snap is: volume-17e88016-e75c-4e89-8de7-11aca84188fc.74da8bfc-d138-4fa3-adb5-5eaae0839df9 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0ce0d2-ba49-4570-9991-d6d24ffdf851]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fc4afbe4-e74e-4457-8982-482fe3d8317f tempest-SnapshotsActionsTest-160643760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.74da8bfc-d138-4fa3-adb5-5eaae0839df9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:28 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.74da8bfc-d138-4fa3-adb5-5eaae0839df9 Jul 17 19:45:28 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:28 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1.2b03563a-974b-4669-a533-de9c6250c12b" returned: 0 in 0.446s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1 {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Creating direct copy from snapshot {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dd8683-3776-47f7-a53f-4ecd210d9a57]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c3ca807c-9b41-472a-aa09-44194cb2d31d tempest-VolumesTestJSON-241033308 None] Acquiring lock "cinder-ffab3db3-b1d4-4c55-8506-9ba460273ec8-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c3ca807c-9b41-472a-aa09-44194cb2d31d tempest-VolumesTestJSON-241033308 None] Lock "cinder-ffab3db3-b1d4-4c55-8506-9ba460273ec8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c3ca807c-9b41-472a-aa09-44194cb2d31d tempest-VolumesTestJSON-241033308 None] Acquiring lock "cinder-quobyte-ffab3db3-b1d4-4c55-8506-9ba460273ec8" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c3ca807c-9b41-472a-aa09-44194cb2d31d tempest-VolumesTestJSON-241033308 None] Lock "cinder-quobyte-ffab3db3-b1d4-4c55-8506-9ba460273ec8" acquired by "delete_volume" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:28 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1 Jul 17 19:45:28 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[e809bdc3-28c8-493d-b3a6-cbb1c2146b0e]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c3ca807c-9b41-472a-aa09-44194cb2d31d tempest-VolumesTestJSON-241033308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ffab3db3-b1d4-4c55-8506-9ba460273ec8 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:28 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fc4afbe4-e74e-4457-8982-482fe3d8317f tempest-SnapshotsActionsTest-160643760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.74da8bfc-d138-4fa3-adb5-5eaae0839df9" returned: 0 in 0.427s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-fc4afbe4-e74e-4457-8982-482fe3d8317f tempest-SnapshotsActionsTest-160643760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17e88016-e75c-4e89-8de7-11aca84188fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:45:28 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ffab3db3-b1d4-4c55-8506-9ba460273ec8 Jul 17 19:45:28 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[570f7064-a6f0-4a45-a153-a61f69f2ccfc]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fc4afbe4-e74e-4457-8982-482fe3d8317f tempest-SnapshotsActionsTest-160643760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:28 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1" returned: 0 in 0.390s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG cinder.utils [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Path /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f258be91-1806-4541-8ce8-a0d95ce7d84d not found in is_blk_device check {{(pid=87726) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 19:45:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f258be91-1806-4541-8ce8-a0d95ce7d84d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:28 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e Jul 17 19:45:28 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:28 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f258be91-1806-4541-8ce8-a0d95ce7d84d Jul 17 19:45:28 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:29 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c3ca807c-9b41-472a-aa09-44194cb2d31d tempest-VolumesTestJSON-241033308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ffab3db3-b1d4-4c55-8506-9ba460273ec8" returned: 0 in 0.386s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c3ca807c-9b41-472a-aa09-44194cb2d31d tempest-VolumesTestJSON-241033308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ffab3db3-b1d4-4c55-8506-9ba460273ec8 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:29 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ffab3db3-b1d4-4c55-8506-9ba460273ec8 Jul 17 19:45:29 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:29 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fc4afbe4-e74e-4457-8982-482fe3d8317f tempest-SnapshotsActionsTest-160643760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e" returned: 0 in 0.399s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:29 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-fc4afbe4-e74e-4457-8982-482fe3d8317f tempest-SnapshotsActionsTest-160643760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17e88016-e75c-4e89-8de7-11aca84188fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:45:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fc4afbe4-e74e-4457-8982-482fe3d8317f tempest-SnapshotsActionsTest-160643760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.74da8bfc-d138-4fa3-adb5-5eaae0839df9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:29 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.74da8bfc-d138-4fa3-adb5-5eaae0839df9 Jul 17 19:45:29 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:29 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c3ca807c-9b41-472a-aa09-44194cb2d31d tempest-VolumesTestJSON-241033308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ffab3db3-b1d4-4c55-8506-9ba460273ec8" returned: 0 in 0.301s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c3ca807c-9b41-472a-aa09-44194cb2d31d tempest-VolumesTestJSON-241033308 None] Lock "cinder-quobyte-ffab3db3-b1d4-4c55-8506-9ba460273ec8" released by "delete_volume" :: held 0.734s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:29 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-c3ca807c-9b41-472a-aa09-44194cb2d31d tempest-VolumesTestJSON-241033308 None] Created reservations ['d556f245-21b1-4f0b-bb0d-16d5884a523f', '96ec9a4a-4d7f-423e-a565-4bbeb261f256', 'cea4c85d-32d6-4655-890c-d1cf9e94efb2', 'd5275816-9b1d-4e98-bb27-04dc27646012'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:45:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c3ca807c-9b41-472a-aa09-44194cb2d31d tempest-VolumesTestJSON-241033308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c3ca807c-9b41-472a-aa09-44194cb2d31d tempest-VolumesTestJSON-241033308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:29 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c3ca807c-9b41-472a-aa09-44194cb2d31d tempest-VolumesTestJSON-241033308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:45:29 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c3ca807c-9b41-472a-aa09-44194cb2d31d tempest-VolumesTestJSON-241033308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:45:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c3ca807c-9b41-472a-aa09-44194cb2d31d tempest-VolumesTestJSON-241033308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c3ca807c-9b41-472a-aa09-44194cb2d31d tempest-VolumesTestJSON-241033308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:29 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:45:29 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-bb52b771-889e-413f-8e63-25336063aef2 tempest-VolumesTestJSON-241033308 None] Acquiring lock "cinder-5c96b6a8-428c-4f56-8dae-76805da0d810-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:30 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-bb52b771-889e-413f-8e63-25336063aef2 tempest-VolumesTestJSON-241033308 None] Lock "cinder-5c96b6a8-428c-4f56-8dae-76805da0d810-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:30 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fc4afbe4-e74e-4457-8982-482fe3d8317f tempest-SnapshotsActionsTest-160643760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.74da8bfc-d138-4fa3-adb5-5eaae0839df9" returned: 0 in 0.815s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fc4afbe4-e74e-4457-8982-482fe3d8317f tempest-SnapshotsActionsTest-160643760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.74da8bfc-d138-4fa3-adb5-5eaae0839df9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:30 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.74da8bfc-d138-4fa3-adb5-5eaae0839df9 Jul 17 19:45:30 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:30 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-bb52b771-889e-413f-8e63-25336063aef2 tempest-VolumesTestJSON-241033308 None] Acquiring lock "cinder-quobyte-5c96b6a8-428c-4f56-8dae-76805da0d810" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:30 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-bb52b771-889e-413f-8e63-25336063aef2 tempest-VolumesTestJSON-241033308 None] Lock "cinder-quobyte-5c96b6a8-428c-4f56-8dae-76805da0d810" acquired by "delete_volume" :: waited 0.070s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:30 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b887c86-e423-4dd6-9ce8-dda60310c492]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bb52b771-889e-413f-8e63-25336063aef2 tempest-VolumesTestJSON-241033308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5c96b6a8-428c-4f56-8dae-76805da0d810 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:30 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c3ca807c-9b41-472a-aa09-44194cb2d31d tempest-VolumesTestJSON-241033308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.925s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:30 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-c3ca807c-9b41-472a-aa09-44194cb2d31d tempest-VolumesTestJSON-241033308 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:45:30 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-c3ca807c-9b41-472a-aa09-44194cb2d31d tempest-VolumesTestJSON-241033308 None] Deleted volume successfully. Jul 17 19:45:30 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5c96b6a8-428c-4f56-8dae-76805da0d810 Jul 17 19:45:30 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:30 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c3ca807c-9b41-472a-aa09-44194cb2d31d tempest-VolumesTestJSON-241033308 None] Lock "cinder-ffab3db3-b1d4-4c55-8506-9ba460273ec8-delete_volume" released by "delete_volume" :: held 2.034s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:30 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fc4afbe4-e74e-4457-8982-482fe3d8317f tempest-SnapshotsActionsTest-160643760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.74da8bfc-d138-4fa3-adb5-5eaae0839df9" returned: 0 in 0.651s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:30 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-fc4afbe4-e74e-4457-8982-482fe3d8317f tempest-SnapshotsActionsTest-160643760 None] Lock "cinder-quobyte-74da8bfc-d138-4fa3-adb5-5eaae0839df9" released by "_delete_snapshot" :: held 2.446s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:30 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-fc4afbe4-e74e-4457-8982-482fe3d8317f tempest-SnapshotsActionsTest-160643760 None] Lock "cinder-quobyte-17e88016-e75c-4e89-8de7-11aca84188fc" released by "delete_snapshot" :: held 2.502s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:31 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-fc4afbe4-e74e-4457-8982-482fe3d8317f tempest-SnapshotsActionsTest-160643760 None] Created reservations ['34a52e08-982e-416d-8eca-e346ed5b121b', 'be8affb7-dcf8-43f9-ab8b-343bd558ca4f', '76f36bd5-7a02-43ff-b38c-98377e1efe6a', '358c6477-f376-4315-9b4e-c171cfe4eccb'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:45:31 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bb52b771-889e-413f-8e63-25336063aef2 tempest-VolumesTestJSON-241033308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5c96b6a8-428c-4f56-8dae-76805da0d810" returned: 0 in 0.774s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bb52b771-889e-413f-8e63-25336063aef2 tempest-VolumesTestJSON-241033308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5c96b6a8-428c-4f56-8dae-76805da0d810 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:31 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5c96b6a8-428c-4f56-8dae-76805da0d810 Jul 17 19:45:31 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:31 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-fc4afbe4-e74e-4457-8982-482fe3d8317f tempest-SnapshotsActionsTest-160643760 None] Delete snapshot completed successfully. Jul 17 19:45:31 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-fc4afbe4-e74e-4457-8982-482fe3d8317f tempest-SnapshotsActionsTest-160643760 None] Lock "cinder-74da8bfc-d138-4fa3-adb5-5eaae0839df9-delete_snapshot" released by "delete_snapshot" :: held 3.194s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:31 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bb52b771-889e-413f-8e63-25336063aef2 tempest-VolumesTestJSON-241033308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5c96b6a8-428c-4f56-8dae-76805da0d810" returned: 0 in 0.644s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:31 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-bb52b771-889e-413f-8e63-25336063aef2 tempest-VolumesTestJSON-241033308 None] Lock "cinder-quobyte-5c96b6a8-428c-4f56-8dae-76805da0d810" released by "delete_volume" :: held 1.518s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:31 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-bb52b771-889e-413f-8e63-25336063aef2 tempest-VolumesTestJSON-241033308 None] Created reservations ['c492b888-303a-471d-bbd9-3e31ab3e280b', '38f83b24-48bd-4745-bf4f-6c731127c599', '38d17f87-069c-4205-8354-a9b60b7f7463', '4f84d784-8c58-41cc-acbb-3dd757cabd64'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:45:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-bb52b771-889e-413f-8e63-25336063aef2 tempest-VolumesTestJSON-241033308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-bb52b771-889e-413f-8e63-25336063aef2 tempest-VolumesTestJSON-241033308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:32 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-bb52b771-889e-413f-8e63-25336063aef2 tempest-VolumesTestJSON-241033308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:45:32 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-bb52b771-889e-413f-8e63-25336063aef2 tempest-VolumesTestJSON-241033308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:45:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-bb52b771-889e-413f-8e63-25336063aef2 tempest-VolumesTestJSON-241033308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bb52b771-889e-413f-8e63-25336063aef2 tempest-VolumesTestJSON-241033308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:32 devstack sudo[97906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:45:32 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:32 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d5613d55-396c-48ef-8412-6eaa9b9dd807 tempest-VolumesTestJSON-241033308 None] Acquiring lock "cinder-1c40bd7a-faf2-4b1f-8636-538833dccab3-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-eac158a5-6efb-4a55-b528-6d2af328d99e tempest-SnapshotsActionsTest-495057273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:32 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d5613d55-396c-48ef-8412-6eaa9b9dd807 tempest-VolumesTestJSON-241033308 None] Lock "cinder-1c40bd7a-faf2-4b1f-8636-538833dccab3-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:32 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d5613d55-396c-48ef-8412-6eaa9b9dd807 tempest-VolumesTestJSON-241033308 None] Acquiring lock "cinder-quobyte-1c40bd7a-faf2-4b1f-8636-538833dccab3" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:32 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d5613d55-396c-48ef-8412-6eaa9b9dd807 tempest-VolumesTestJSON-241033308 None] Lock "cinder-quobyte-1c40bd7a-faf2-4b1f-8636-538833dccab3" acquired by "delete_volume" :: waited 0.031s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:32 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9c47c2-8681-498a-9705-5cf579909f9b]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d5613d55-396c-48ef-8412-6eaa9b9dd807 tempest-VolumesTestJSON-241033308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1c40bd7a-faf2-4b1f-8636-538833dccab3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:32 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bb52b771-889e-413f-8e63-25336063aef2 tempest-VolumesTestJSON-241033308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.694s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:32 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-bb52b771-889e-413f-8e63-25336063aef2 tempest-VolumesTestJSON-241033308 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:45:32 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-bb52b771-889e-413f-8e63-25336063aef2 tempest-VolumesTestJSON-241033308 None] Deleted volume successfully. Jul 17 19:45:32 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-bb52b771-889e-413f-8e63-25336063aef2 tempest-VolumesTestJSON-241033308 None] Lock "cinder-5c96b6a8-428c-4f56-8dae-76805da0d810-delete_volume" released by "delete_volume" :: held 2.883s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:33 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1c40bd7a-faf2-4b1f-8636-538833dccab3 Jul 17 19:45:33 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:33 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d5613d55-396c-48ef-8412-6eaa9b9dd807 tempest-VolumesTestJSON-241033308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1c40bd7a-faf2-4b1f-8636-538833dccab3" returned: 0 in 0.780s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d5613d55-396c-48ef-8412-6eaa9b9dd807 tempest-VolumesTestJSON-241033308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1c40bd7a-faf2-4b1f-8636-538833dccab3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:33 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1c40bd7a-faf2-4b1f-8636-538833dccab3 Jul 17 19:45:33 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:34 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d5613d55-396c-48ef-8412-6eaa9b9dd807 tempest-VolumesTestJSON-241033308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1c40bd7a-faf2-4b1f-8636-538833dccab3" returned: 0 in 0.473s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:34 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d5613d55-396c-48ef-8412-6eaa9b9dd807 tempest-VolumesTestJSON-241033308 None] Lock "cinder-quobyte-1c40bd7a-faf2-4b1f-8636-538833dccab3" released by "delete_volume" :: held 1.338s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:34 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f258be91-1806-4541-8ce8-a0d95ce7d84d" returned: 0 in 5.107s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:34 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[e393fb2d-e4b2-4dfb-aea1-e6676e3711b4]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:34 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-d5613d55-396c-48ef-8412-6eaa9b9dd807 tempest-VolumesTestJSON-241033308 None] Created reservations ['ed85dd58-2fb4-47b2-a3c3-1642547ba7ea', '6d3fc295-2f73-4543-a3c0-c9936627c7c6', '2fbfdec4-7b77-48b0-8eb7-2f1cf673b2e8', '39a44926-09c2-4cbf-8ed9-e2a4fc92bd88'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:45:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d5613d55-396c-48ef-8412-6eaa9b9dd807 tempest-VolumesTestJSON-241033308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d5613d55-396c-48ef-8412-6eaa9b9dd807 tempest-VolumesTestJSON-241033308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:34 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d5613d55-396c-48ef-8412-6eaa9b9dd807 tempest-VolumesTestJSON-241033308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:45:34 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d5613d55-396c-48ef-8412-6eaa9b9dd807 tempest-VolumesTestJSON-241033308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:45:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d5613d55-396c-48ef-8412-6eaa9b9dd807 tempest-VolumesTestJSON-241033308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d5613d55-396c-48ef-8412-6eaa9b9dd807 tempest-VolumesTestJSON-241033308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:34 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1 Jul 17 19:45:34 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:34 devstack sudo[97920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:45:34 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:34 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d5613d55-396c-48ef-8412-6eaa9b9dd807 tempest-VolumesTestJSON-241033308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.241s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:34 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-d5613d55-396c-48ef-8412-6eaa9b9dd807 tempest-VolumesTestJSON-241033308 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:45:34 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-d5613d55-396c-48ef-8412-6eaa9b9dd807 tempest-VolumesTestJSON-241033308 None] Deleted volume successfully. Jul 17 19:45:34 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d5613d55-396c-48ef-8412-6eaa9b9dd807 tempest-VolumesTestJSON-241033308 None] Lock "cinder-1c40bd7a-faf2-4b1f-8636-538833dccab3-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:34 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1" returned: 0 in 0.549s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:34 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Image conversion details: src /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1, size 1024.00 MB, duration 5.11 sec, destination /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f258be91-1806-4541-8ce8-a0d95ce7d84d {{(pid=87726) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 19:45:34 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Converted 1024.00 MB image at 200.46 MB/s Jul 17 19:45:34 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f258be91-1806-4541-8ce8-a0d95ce7d84d is being set with open permissions: ugo+rw Jul 17 19:45:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f258be91-1806-4541-8ce8-a0d95ce7d84d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:34 devstack sudo[97927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f258be91-1806-4541-8ce8-a0d95ce7d84d Jul 17 19:45:34 devstack sudo[97927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:34 devstack sudo[97927]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f258be91-1806-4541-8ce8-a0d95ce7d84d" returned: 0 in 0.235s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:34 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-quobyte-f258be91-1806-4541-8ce8-a0d95ce7d84d" released by "_copy_volume_from_snapshot" :: held 6.835s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:34 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-quobyte-2b03563a-974b-4669-a533-de9c6250c12b-f258be91-1806-4541-8ce8-a0d95ce7d84d" released by "_create_volume_from_snapshot" :: held 6.871s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.900s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-eac158a5-6efb-4a55-b528-6d2af328d99e tempest-SnapshotsActionsTest-495057273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.320s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:34 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-eac158a5-6efb-4a55-b528-6d2af328d99e tempest-SnapshotsActionsTest-495057273 None] Creating offline snapshot 540b9d03-583f-46bd-b7d4-51ec2d59a0ff of volume 17e88016-e75c-4e89-8de7-11aca84188fc {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:45:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c1e502-fb12-44ba-a9f2-4fd5a2b35566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f258be91-1806-4541-8ce8-a0d95ce7d84d', 'volume_size': 1, 'snapshot_id': '2b03563a-974b-4669-a533-de9c6250c12b'}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a65368d-65cf-4c6d-8e2c-78e9fb6857c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:45:34 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[42995b4e-d2e1-420a-bc3e-d84f42bb95f8]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-eac158a5-6efb-4a55-b528-6d2af328d99e tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:35 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Volume volume-f258be91-1806-4541-8ce8-a0d95ce7d84d (f258be91-1806-4541-8ce8-a0d95ce7d84d): created successfully Jul 17 19:45:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a65368d-65cf-4c6d-8e2c-78e9fb6857c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:45:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Flow 'volume_create_manager' (981e43f2-5890-4395-8b92-7189c00b4edc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:45:35 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-273513c0-61c7-4110-b487-871f5bd9d232 tempest-VolumesSnapshotTestJSON-1650241216 None] Created volume successfully. Jul 17 19:45:35 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e Jul 17 19:45:35 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:35 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-eac158a5-6efb-4a55-b528-6d2af328d99e tempest-SnapshotsActionsTest-495057273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e" returned: 0 in 0.368s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:35 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-eac158a5-6efb-4a55-b528-6d2af328d99e tempest-SnapshotsActionsTest-495057273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17e88016-e75c-4e89-8de7-11aca84188fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:45:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-eac158a5-6efb-4a55-b528-6d2af328d99e tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.540b9d03-583f-46bd-b7d4-51ec2d59a0ff 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:35 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.540b9d03-583f-46bd-b7d4-51ec2d59a0ff 1G Jul 17 19:45:35 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:35 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-eac158a5-6efb-4a55-b528-6d2af328d99e tempest-SnapshotsActionsTest-495057273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.540b9d03-583f-46bd-b7d4-51ec2d59a0ff 1G" returned: 0 in 0.451s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-eac158a5-6efb-4a55-b528-6d2af328d99e tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.540b9d03-583f-46bd-b7d4-51ec2d59a0ff {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:35 devstack sudo[97941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.540b9d03-583f-46bd-b7d4-51ec2d59a0ff Jul 17 19:45:35 devstack sudo[97941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:36 devstack sudo[97941]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-eac158a5-6efb-4a55-b528-6d2af328d99e tempest-SnapshotsActionsTest-495057273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.540b9d03-583f-46bd-b7d4-51ec2d59a0ff" returned: 0 in 0.334s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:36 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-eac158a5-6efb-4a55-b528-6d2af328d99e tempest-SnapshotsActionsTest-495057273 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.540b9d03-583f-46bd-b7d4-51ec2d59a0ff is being set with open permissions: ugo+rw Jul 17 19:45:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-eac158a5-6efb-4a55-b528-6d2af328d99e tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.540b9d03-583f-46bd-b7d4-51ec2d59a0ff {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:36 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.540b9d03-583f-46bd-b7d4-51ec2d59a0ff Jul 17 19:45:36 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2daff7ac-0bfd-48bc-9cc5-681b60b402e1 tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "cinder-f258be91-1806-4541-8ce8-a0d95ce7d84d-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2daff7ac-0bfd-48bc-9cc5-681b60b402e1 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-f258be91-1806-4541-8ce8-a0d95ce7d84d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2daff7ac-0bfd-48bc-9cc5-681b60b402e1 tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "cinder-quobyte-f258be91-1806-4541-8ce8-a0d95ce7d84d" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2daff7ac-0bfd-48bc-9cc5-681b60b402e1 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-quobyte-f258be91-1806-4541-8ce8-a0d95ce7d84d" acquired by "delete_volume" :: waited 0.026s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:36 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78c1a7a-4c04-4d62-9113-78ad83193d4a]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2daff7ac-0bfd-48bc-9cc5-681b60b402e1 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f258be91-1806-4541-8ce8-a0d95ce7d84d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:36 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-eac158a5-6efb-4a55-b528-6d2af328d99e tempest-SnapshotsActionsTest-495057273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.540b9d03-583f-46bd-b7d4-51ec2d59a0ff" returned: 0 in 0.282s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:36 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f258be91-1806-4541-8ce8-a0d95ce7d84d Jul 17 19:45:36 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-eac158a5-6efb-4a55-b528-6d2af328d99e tempest-SnapshotsActionsTest-495057273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.573s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:36 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-eac158a5-6efb-4a55-b528-6d2af328d99e tempest-SnapshotsActionsTest-495057273 None] Create snapshot completed successfully Jul 17 19:45:36 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2daff7ac-0bfd-48bc-9cc5-681b60b402e1 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f258be91-1806-4541-8ce8-a0d95ce7d84d" returned: 0 in 0.457s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2daff7ac-0bfd-48bc-9cc5-681b60b402e1 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f258be91-1806-4541-8ce8-a0d95ce7d84d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:36 devstack sudo[97954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f258be91-1806-4541-8ce8-a0d95ce7d84d Jul 17 19:45:36 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ef16daec-3c4b-4abb-a556-a9164708208e tempest-SnapshotsActionsTest-160643760 None] Acquiring lock "cinder-540b9d03-583f-46bd-b7d4-51ec2d59a0ff-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ef16daec-3c4b-4abb-a556-a9164708208e tempest-SnapshotsActionsTest-160643760 None] Lock "cinder-540b9d03-583f-46bd-b7d4-51ec2d59a0ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ef16daec-3c4b-4abb-a556-a9164708208e tempest-SnapshotsActionsTest-160643760 None] Acquiring lock "cinder-quobyte-17e88016-e75c-4e89-8de7-11aca84188fc" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ef16daec-3c4b-4abb-a556-a9164708208e tempest-SnapshotsActionsTest-160643760 None] Lock "cinder-quobyte-17e88016-e75c-4e89-8de7-11aca84188fc" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ef16daec-3c4b-4abb-a556-a9164708208e tempest-SnapshotsActionsTest-160643760 None] Acquiring lock "cinder-quobyte-540b9d03-583f-46bd-b7d4-51ec2d59a0ff" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ef16daec-3c4b-4abb-a556-a9164708208e tempest-SnapshotsActionsTest-160643760 None] Lock "cinder-quobyte-540b9d03-583f-46bd-b7d4-51ec2d59a0ff" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-ef16daec-3c4b-4abb-a556-a9164708208e tempest-SnapshotsActionsTest-160643760 None] Deleting offline snapshot 540b9d03-583f-46bd-b7d4-51ec2d59a0ff of volume 17e88016-e75c-4e89-8de7-11aca84188fc {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:45:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-ef16daec-3c4b-4abb-a556-a9164708208e tempest-SnapshotsActionsTest-160643760 None] snapshot_file for this snap is: volume-17e88016-e75c-4e89-8de7-11aca84188fc.540b9d03-583f-46bd-b7d4-51ec2d59a0ff {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:45:36 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a5a91b-2853-42c8-8e22-c7712c866781]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ef16daec-3c4b-4abb-a556-a9164708208e tempest-SnapshotsActionsTest-160643760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.540b9d03-583f-46bd-b7d4-51ec2d59a0ff {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:37 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2daff7ac-0bfd-48bc-9cc5-681b60b402e1 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f258be91-1806-4541-8ce8-a0d95ce7d84d" returned: 0 in 0.272s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:37 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.540b9d03-583f-46bd-b7d4-51ec2d59a0ff Jul 17 19:45:37 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2daff7ac-0bfd-48bc-9cc5-681b60b402e1 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-quobyte-f258be91-1806-4541-8ce8-a0d95ce7d84d" released by "delete_volume" :: held 0.782s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-2daff7ac-0bfd-48bc-9cc5-681b60b402e1 tempest-VolumesSnapshotTestJSON-1650241216 None] Created reservations ['9ae73ebd-0866-450b-a007-ecb1eb6808e4', 'c1a500f3-5760-4e11-a4cf-d99610e5465e', '43a856de-7d98-4cdb-aa6f-94983c37d491', 'ce94308f-5b3c-4fc4-b681-4fdb67945054'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-2daff7ac-0bfd-48bc-9cc5-681b60b402e1 tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-2daff7ac-0bfd-48bc-9cc5-681b60b402e1 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-2daff7ac-0bfd-48bc-9cc5-681b60b402e1 tempest-VolumesSnapshotTestJSON-1650241216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-2daff7ac-0bfd-48bc-9cc5-681b60b402e1 tempest-VolumesSnapshotTestJSON-1650241216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-2daff7ac-0bfd-48bc-9cc5-681b60b402e1 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2daff7ac-0bfd-48bc-9cc5-681b60b402e1 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:37 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:45:37 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:37 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ef16daec-3c4b-4abb-a556-a9164708208e tempest-SnapshotsActionsTest-160643760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.540b9d03-583f-46bd-b7d4-51ec2d59a0ff" returned: 0 in 0.437s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-ef16daec-3c4b-4abb-a556-a9164708208e tempest-SnapshotsActionsTest-160643760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17e88016-e75c-4e89-8de7-11aca84188fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e278f37-14f5-42f8-bb4f-49c27ae18d18]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ef16daec-3c4b-4abb-a556-a9164708208e tempest-SnapshotsActionsTest-160643760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-784b7aa2-188d-4b87-86ee-466fdba29c98 tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "cinder-2b03563a-974b-4669-a533-de9c6250c12b-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-784b7aa2-188d-4b87-86ee-466fdba29c98 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-2b03563a-974b-4669-a533-de9c6250c12b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-784b7aa2-188d-4b87-86ee-466fdba29c98 tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "cinder-quobyte-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-784b7aa2-188d-4b87-86ee-466fdba29c98 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-quobyte-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-784b7aa2-188d-4b87-86ee-466fdba29c98 tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "cinder-quobyte-2b03563a-974b-4669-a533-de9c6250c12b" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:37 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e Jul 17 19:45:37 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-784b7aa2-188d-4b87-86ee-466fdba29c98 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-quobyte-2b03563a-974b-4669-a533-de9c6250c12b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-784b7aa2-188d-4b87-86ee-466fdba29c98 tempest-VolumesSnapshotTestJSON-1650241216 None] Deleting offline snapshot 2b03563a-974b-4669-a533-de9c6250c12b of volume ef442927-2f2f-4ac8-8940-ba5cff1ec2a1 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:45:37 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-784b7aa2-188d-4b87-86ee-466fdba29c98 tempest-VolumesSnapshotTestJSON-1650241216 None] snapshot_file for this snap is: volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1.2b03563a-974b-4669-a533-de9c6250c12b {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2daff7ac-0bfd-48bc-9cc5-681b60b402e1 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.365s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-2daff7ac-0bfd-48bc-9cc5-681b60b402e1 tempest-VolumesSnapshotTestJSON-1650241216 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:45:37 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-2daff7ac-0bfd-48bc-9cc5-681b60b402e1 tempest-VolumesSnapshotTestJSON-1650241216 None] Deleted volume successfully. Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac29ab7-6ade-4ac4-ac35-b5a6a7f6abc3]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-784b7aa2-188d-4b87-86ee-466fdba29c98 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1.2b03563a-974b-4669-a533-de9c6250c12b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2daff7ac-0bfd-48bc-9cc5-681b60b402e1 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-f258be91-1806-4541-8ce8-a0d95ce7d84d-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:37 devstack sudo[97967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1.2b03563a-974b-4669-a533-de9c6250c12b Jul 17 19:45:37 devstack sudo[97967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:37 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ef16daec-3c4b-4abb-a556-a9164708208e tempest-SnapshotsActionsTest-160643760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e" returned: 0 in 0.439s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-ef16daec-3c4b-4abb-a556-a9164708208e tempest-SnapshotsActionsTest-160643760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17e88016-e75c-4e89-8de7-11aca84188fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ef16daec-3c4b-4abb-a556-a9164708208e tempest-SnapshotsActionsTest-160643760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.540b9d03-583f-46bd-b7d4-51ec2d59a0ff {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:37 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.540b9d03-583f-46bd-b7d4-51ec2d59a0ff Jul 17 19:45:37 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:37 devstack sudo[97967]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-784b7aa2-188d-4b87-86ee-466fdba29c98 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1.2b03563a-974b-4669-a533-de9c6250c12b" returned: 0 in 0.413s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-784b7aa2-188d-4b87-86ee-466fdba29c98 tempest-VolumesSnapshotTestJSON-1650241216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:45:38 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[651a6198-10d8-4658-b64f-8abf6ad93969]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-784b7aa2-188d-4b87-86ee-466fdba29c98 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:38 devstack sudo[97977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1 Jul 17 19:45:38 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:38 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ef16daec-3c4b-4abb-a556-a9164708208e tempest-SnapshotsActionsTest-160643760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.540b9d03-583f-46bd-b7d4-51ec2d59a0ff" returned: 0 in 0.454s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ef16daec-3c4b-4abb-a556-a9164708208e tempest-SnapshotsActionsTest-160643760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.540b9d03-583f-46bd-b7d4-51ec2d59a0ff {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:38 devstack sudo[97982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.540b9d03-583f-46bd-b7d4-51ec2d59a0ff Jul 17 19:45:38 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:38 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-784b7aa2-188d-4b87-86ee-466fdba29c98 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1" returned: 0 in 0.392s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-784b7aa2-188d-4b87-86ee-466fdba29c98 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1.2b03563a-974b-4669-a533-de9c6250c12b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:38 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1.2b03563a-974b-4669-a533-de9c6250c12b Jul 17 19:45:38 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:38 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ef16daec-3c4b-4abb-a556-a9164708208e tempest-SnapshotsActionsTest-160643760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.540b9d03-583f-46bd-b7d4-51ec2d59a0ff" returned: 0 in 0.270s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:38 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ef16daec-3c4b-4abb-a556-a9164708208e tempest-SnapshotsActionsTest-160643760 None] Lock "cinder-quobyte-540b9d03-583f-46bd-b7d4-51ec2d59a0ff" released by "_delete_snapshot" :: held 1.742s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:38 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ef16daec-3c4b-4abb-a556-a9164708208e tempest-SnapshotsActionsTest-160643760 None] Lock "cinder-quobyte-17e88016-e75c-4e89-8de7-11aca84188fc" released by "delete_snapshot" :: held 1.769s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:38 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-ef16daec-3c4b-4abb-a556-a9164708208e tempest-SnapshotsActionsTest-160643760 None] Created reservations ['acfbc6be-705c-4141-a836-53c62dcfe049', '79da8d70-909f-455f-b43a-38095752c0d9', '1959b0c6-d2f3-4ece-86ca-739ade356ef1', '68f80c3a-6c59-454e-8bcf-c0eae8055fb6'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:45:38 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-ef16daec-3c4b-4abb-a556-a9164708208e tempest-SnapshotsActionsTest-160643760 None] Delete snapshot completed successfully. Jul 17 19:45:38 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ef16daec-3c4b-4abb-a556-a9164708208e tempest-SnapshotsActionsTest-160643760 None] Lock "cinder-540b9d03-583f-46bd-b7d4-51ec2d59a0ff-delete_snapshot" released by "delete_snapshot" :: held 1.942s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:38 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-784b7aa2-188d-4b87-86ee-466fdba29c98 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1.2b03563a-974b-4669-a533-de9c6250c12b" returned: 0 in 0.415s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-784b7aa2-188d-4b87-86ee-466fdba29c98 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1.2b03563a-974b-4669-a533-de9c6250c12b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:38 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1.2b03563a-974b-4669-a533-de9c6250c12b Jul 17 19:45:38 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:39 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-784b7aa2-188d-4b87-86ee-466fdba29c98 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1.2b03563a-974b-4669-a533-de9c6250c12b" returned: 0 in 0.324s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:39 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-784b7aa2-188d-4b87-86ee-466fdba29c98 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-quobyte-2b03563a-974b-4669-a533-de9c6250c12b" released by "_delete_snapshot" :: held 1.687s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:39 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-784b7aa2-188d-4b87-86ee-466fdba29c98 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-quobyte-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1" released by "delete_snapshot" :: held 1.722s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-70259593-d499-4e7a-b8c4-42dd2f976029 tempest-SnapshotsActionsTest-495057273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-70259593-d499-4e7a-b8c4-42dd2f976029 tempest-SnapshotsActionsTest-495057273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:39 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-70259593-d499-4e7a-b8c4-42dd2f976029 tempest-SnapshotsActionsTest-495057273 None] Creating offline snapshot dfb3c2b3-33c4-4fe5-9384-c0fcb705d754 of volume 17e88016-e75c-4e89-8de7-11aca84188fc {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:45:39 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf26f738-ff77-4fed-8721-11363e5c5978]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-70259593-d499-4e7a-b8c4-42dd2f976029 tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:39 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-784b7aa2-188d-4b87-86ee-466fdba29c98 tempest-VolumesSnapshotTestJSON-1650241216 None] Created reservations ['34adf966-2f55-4c75-a5bf-a437ebf5143b', 'f9d9a8eb-10df-4c17-9c07-40b082b89a12', '0f4964e2-edd9-46db-bdeb-0b151905a828', '4e1982f3-b716-45bc-87eb-1dc6af6e320d'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:45:39 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-784b7aa2-188d-4b87-86ee-466fdba29c98 tempest-VolumesSnapshotTestJSON-1650241216 None] Delete snapshot completed successfully. Jul 17 19:45:39 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-784b7aa2-188d-4b87-86ee-466fdba29c98 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-2b03563a-974b-4669-a533-de9c6250c12b-delete_snapshot" released by "delete_snapshot" :: held 1.979s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:39 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e Jul 17 19:45:39 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:39 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-70259593-d499-4e7a-b8c4-42dd2f976029 tempest-SnapshotsActionsTest-495057273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e" returned: 0 in 0.400s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:39 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-70259593-d499-4e7a-b8c4-42dd2f976029 tempest-SnapshotsActionsTest-495057273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17e88016-e75c-4e89-8de7-11aca84188fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:45:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-70259593-d499-4e7a-b8c4-42dd2f976029 tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.dfb3c2b3-33c4-4fe5-9384-c0fcb705d754 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:39 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6ba66c6c-5885-4d8f-9bdb-0008d2fa2fd9 tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "cinder-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:39 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.dfb3c2b3-33c4-4fe5-9384-c0fcb705d754 1G Jul 17 19:45:39 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:39 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6ba66c6c-5885-4d8f-9bdb-0008d2fa2fd9 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:39 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6ba66c6c-5885-4d8f-9bdb-0008d2fa2fd9 tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "cinder-quobyte-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:39 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6ba66c6c-5885-4d8f-9bdb-0008d2fa2fd9 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-quobyte-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1" acquired by "delete_volume" :: waited 0.015s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:39 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c62c248-6e32-4042-995b-1c193097df99]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6ba66c6c-5885-4d8f-9bdb-0008d2fa2fd9 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:40 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1 Jul 17 19:45:40 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:40 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-70259593-d499-4e7a-b8c4-42dd2f976029 tempest-SnapshotsActionsTest-495057273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.dfb3c2b3-33c4-4fe5-9384-c0fcb705d754 1G" returned: 0 in 0.536s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-70259593-d499-4e7a-b8c4-42dd2f976029 tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.dfb3c2b3-33c4-4fe5-9384-c0fcb705d754 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:40 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6ba66c6c-5885-4d8f-9bdb-0008d2fa2fd9 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1" returned: 0 in 0.412s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6ba66c6c-5885-4d8f-9bdb-0008d2fa2fd9 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:40 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.dfb3c2b3-33c4-4fe5-9384-c0fcb705d754 Jul 17 19:45:40 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:40 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1 Jul 17 19:45:40 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:40 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-70259593-d499-4e7a-b8c4-42dd2f976029 tempest-SnapshotsActionsTest-495057273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.dfb3c2b3-33c4-4fe5-9384-c0fcb705d754" returned: 0 in 0.344s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:40 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-70259593-d499-4e7a-b8c4-42dd2f976029 tempest-SnapshotsActionsTest-495057273 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.dfb3c2b3-33c4-4fe5-9384-c0fcb705d754 is being set with open permissions: ugo+rw Jul 17 19:45:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-70259593-d499-4e7a-b8c4-42dd2f976029 tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.dfb3c2b3-33c4-4fe5-9384-c0fcb705d754 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:40 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6ba66c6c-5885-4d8f-9bdb-0008d2fa2fd9 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1" returned: 0 in 0.323s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:40 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6ba66c6c-5885-4d8f-9bdb-0008d2fa2fd9 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-quobyte-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1" released by "delete_volume" :: held 0.805s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:40 devstack sudo[98022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.dfb3c2b3-33c4-4fe5-9384-c0fcb705d754 Jul 17 19:45:40 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:40 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-6ba66c6c-5885-4d8f-9bdb-0008d2fa2fd9 tempest-VolumesSnapshotTestJSON-1650241216 None] Created reservations ['0aab13c3-e6f0-473d-b595-216ab1ab43d2', 'fa32cd8e-b69a-4c59-bb20-0260a655fd32', '64a2a914-0473-4e11-8786-f3246843da1e', 'bfd5cbb9-e928-4ce3-b72e-08764037f6b6'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:45:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6ba66c6c-5885-4d8f-9bdb-0008d2fa2fd9 tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6ba66c6c-5885-4d8f-9bdb-0008d2fa2fd9 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:40 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6ba66c6c-5885-4d8f-9bdb-0008d2fa2fd9 tempest-VolumesSnapshotTestJSON-1650241216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:45:40 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6ba66c6c-5885-4d8f-9bdb-0008d2fa2fd9 tempest-VolumesSnapshotTestJSON-1650241216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:45:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6ba66c6c-5885-4d8f-9bdb-0008d2fa2fd9 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6ba66c6c-5885-4d8f-9bdb-0008d2fa2fd9 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:40 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:45:40 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:40 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-70259593-d499-4e7a-b8c4-42dd2f976029 tempest-SnapshotsActionsTest-495057273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.dfb3c2b3-33c4-4fe5-9384-c0fcb705d754" returned: 0 in 0.352s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-70259593-d499-4e7a-b8c4-42dd2f976029 tempest-SnapshotsActionsTest-495057273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.757s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:41 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-41c55d4e-3f93-4ea2-9ad3-295186b05b78 tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "cinder-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:41 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-41c55d4e-3f93-4ea2-9ad3-295186b05b78 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:41 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-70259593-d499-4e7a-b8c4-42dd2f976029 tempest-SnapshotsActionsTest-495057273 None] Create snapshot completed successfully Jul 17 19:45:41 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:41 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-41c55d4e-3f93-4ea2-9ad3-295186b05b78 tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "cinder-quobyte-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6ba66c6c-5885-4d8f-9bdb-0008d2fa2fd9 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.326s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:41 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-6ba66c6c-5885-4d8f-9bdb-0008d2fa2fd9 tempest-VolumesSnapshotTestJSON-1650241216 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:45:41 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-6ba66c6c-5885-4d8f-9bdb-0008d2fa2fd9 tempest-VolumesSnapshotTestJSON-1650241216 None] Deleted volume successfully. Jul 17 19:45:41 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-41c55d4e-3f93-4ea2-9ad3-295186b05b78 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-quobyte-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05" acquired by "delete_volume" :: waited 0.029s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:41 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6ba66c6c-5885-4d8f-9bdb-0008d2fa2fd9 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-ef442927-2f2f-4ac8-8940-ba5cff1ec2a1-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:41 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7530cda-2d92-4d04-936b-47f4105299ca]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-41c55d4e-3f93-4ea2-9ad3-295186b05b78 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:41 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05 Jul 17 19:45:41 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:41 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e830b005-d942-41f4-a8f2-1f131f9b1ea9 tempest-SnapshotsActionsTest-160643760 None] Acquiring lock "cinder-dfb3c2b3-33c4-4fe5-9384-c0fcb705d754-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:41 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e830b005-d942-41f4-a8f2-1f131f9b1ea9 tempest-SnapshotsActionsTest-160643760 None] Lock "cinder-dfb3c2b3-33c4-4fe5-9384-c0fcb705d754-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:41 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e830b005-d942-41f4-a8f2-1f131f9b1ea9 tempest-SnapshotsActionsTest-160643760 None] Acquiring lock "cinder-quobyte-17e88016-e75c-4e89-8de7-11aca84188fc" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:41 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e830b005-d942-41f4-a8f2-1f131f9b1ea9 tempest-SnapshotsActionsTest-160643760 None] Lock "cinder-quobyte-17e88016-e75c-4e89-8de7-11aca84188fc" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:41 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e830b005-d942-41f4-a8f2-1f131f9b1ea9 tempest-SnapshotsActionsTest-160643760 None] Acquiring lock "cinder-quobyte-dfb3c2b3-33c4-4fe5-9384-c0fcb705d754" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:41 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e830b005-d942-41f4-a8f2-1f131f9b1ea9 tempest-SnapshotsActionsTest-160643760 None] Lock "cinder-quobyte-dfb3c2b3-33c4-4fe5-9384-c0fcb705d754" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:41 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-e830b005-d942-41f4-a8f2-1f131f9b1ea9 tempest-SnapshotsActionsTest-160643760 None] Deleting offline snapshot dfb3c2b3-33c4-4fe5-9384-c0fcb705d754 of volume 17e88016-e75c-4e89-8de7-11aca84188fc {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:45:41 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-e830b005-d942-41f4-a8f2-1f131f9b1ea9 tempest-SnapshotsActionsTest-160643760 None] snapshot_file for this snap is: volume-17e88016-e75c-4e89-8de7-11aca84188fc.dfb3c2b3-33c4-4fe5-9384-c0fcb705d754 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:45:41 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[090ac3b6-9aab-4062-84f0-7afe771a6d70]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e830b005-d942-41f4-a8f2-1f131f9b1ea9 tempest-SnapshotsActionsTest-160643760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.dfb3c2b3-33c4-4fe5-9384-c0fcb705d754 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:41 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.dfb3c2b3-33c4-4fe5-9384-c0fcb705d754 Jul 17 19:45:41 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:41 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-41c55d4e-3f93-4ea2-9ad3-295186b05b78 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05" returned: 0 in 0.485s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-41c55d4e-3f93-4ea2-9ad3-295186b05b78 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:41 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05 Jul 17 19:45:41 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:41 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-41c55d4e-3f93-4ea2-9ad3-295186b05b78 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05" returned: 0 in 0.257s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:41 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e830b005-d942-41f4-a8f2-1f131f9b1ea9 tempest-SnapshotsActionsTest-160643760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.dfb3c2b3-33c4-4fe5-9384-c0fcb705d754" returned: 0 in 0.406s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:41 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-e830b005-d942-41f4-a8f2-1f131f9b1ea9 tempest-SnapshotsActionsTest-160643760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17e88016-e75c-4e89-8de7-11aca84188fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:45:42 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-41c55d4e-3f93-4ea2-9ad3-295186b05b78 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-quobyte-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05" released by "delete_volume" :: held 0.842s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:42 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[85883447-c13e-4d67-9482-7478049225ff]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e830b005-d942-41f4-a8f2-1f131f9b1ea9 tempest-SnapshotsActionsTest-160643760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:42 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-41c55d4e-3f93-4ea2-9ad3-295186b05b78 tempest-VolumesSnapshotTestJSON-1650241216 None] Created reservations ['2c5d3eb2-8c3f-42d7-a439-5a5d854a70e2', '690310f3-34ef-4ba2-9490-aaa21b8751ac', 'e2d1e9a6-d10e-4961-86a0-1516a39aaf25', 'a958f783-5e72-49cc-81e6-82064f64f7e9'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:45:42 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e Jul 17 19:45:42 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-41c55d4e-3f93-4ea2-9ad3-295186b05b78 tempest-VolumesSnapshotTestJSON-1650241216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-41c55d4e-3f93-4ea2-9ad3-295186b05b78 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:42 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-41c55d4e-3f93-4ea2-9ad3-295186b05b78 tempest-VolumesSnapshotTestJSON-1650241216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:45:42 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-41c55d4e-3f93-4ea2-9ad3-295186b05b78 tempest-VolumesSnapshotTestJSON-1650241216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:45:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-41c55d4e-3f93-4ea2-9ad3-295186b05b78 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-41c55d4e-3f93-4ea2-9ad3-295186b05b78 tempest-VolumesSnapshotTestJSON-1650241216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:42 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:45:42 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:42 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e830b005-d942-41f4-a8f2-1f131f9b1ea9 tempest-SnapshotsActionsTest-160643760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e" returned: 0 in 0.408s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:42 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-e830b005-d942-41f4-a8f2-1f131f9b1ea9 tempest-SnapshotsActionsTest-160643760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17e88016-e75c-4e89-8de7-11aca84188fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:45:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e830b005-d942-41f4-a8f2-1f131f9b1ea9 tempest-SnapshotsActionsTest-160643760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.dfb3c2b3-33c4-4fe5-9384-c0fcb705d754 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:42 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.dfb3c2b3-33c4-4fe5-9384-c0fcb705d754 Jul 17 19:45:42 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:42 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-41c55d4e-3f93-4ea2-9ad3-295186b05b78 tempest-VolumesSnapshotTestJSON-1650241216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.325s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:42 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-41c55d4e-3f93-4ea2-9ad3-295186b05b78 tempest-VolumesSnapshotTestJSON-1650241216 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:45:42 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-41c55d4e-3f93-4ea2-9ad3-295186b05b78 tempest-VolumesSnapshotTestJSON-1650241216 None] Deleted volume successfully. Jul 17 19:45:42 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-41c55d4e-3f93-4ea2-9ad3-295186b05b78 tempest-VolumesSnapshotTestJSON-1650241216 None] Lock "cinder-2a6ae0eb-f78e-46b2-a7b1-f8bb745f8e05-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:42 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e830b005-d942-41f4-a8f2-1f131f9b1ea9 tempest-SnapshotsActionsTest-160643760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.dfb3c2b3-33c4-4fe5-9384-c0fcb705d754" returned: 0 in 0.475s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e830b005-d942-41f4-a8f2-1f131f9b1ea9 tempest-SnapshotsActionsTest-160643760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.dfb3c2b3-33c4-4fe5-9384-c0fcb705d754 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:42 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.dfb3c2b3-33c4-4fe5-9384-c0fcb705d754 Jul 17 19:45:42 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:43 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e830b005-d942-41f4-a8f2-1f131f9b1ea9 tempest-SnapshotsActionsTest-160643760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.dfb3c2b3-33c4-4fe5-9384-c0fcb705d754" returned: 0 in 0.305s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:43 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e830b005-d942-41f4-a8f2-1f131f9b1ea9 tempest-SnapshotsActionsTest-160643760 None] Lock "cinder-quobyte-dfb3c2b3-33c4-4fe5-9384-c0fcb705d754" released by "_delete_snapshot" :: held 1.717s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:43 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e830b005-d942-41f4-a8f2-1f131f9b1ea9 tempest-SnapshotsActionsTest-160643760 None] Lock "cinder-quobyte-17e88016-e75c-4e89-8de7-11aca84188fc" released by "delete_snapshot" :: held 1.743s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:43 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-e830b005-d942-41f4-a8f2-1f131f9b1ea9 tempest-SnapshotsActionsTest-160643760 None] Created reservations ['91907baf-ed3e-414d-a82f-7e82249e83e9', 'db3b1ee7-3928-4adb-854e-d1854f2e8500', '8b1667a1-6073-424a-b228-ddffdac85ce8', 'a7dd9b47-ea1f-44df-8801-8b5203030746'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:45:43 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e830b005-d942-41f4-a8f2-1f131f9b1ea9 tempest-SnapshotsActionsTest-160643760 None] Delete snapshot completed successfully. Jul 17 19:45:43 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e830b005-d942-41f4-a8f2-1f131f9b1ea9 tempest-SnapshotsActionsTest-160643760 None] Lock "cinder-dfb3c2b3-33c4-4fe5-9384-c0fcb705d754-delete_snapshot" released by "delete_snapshot" :: held 1.935s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:44 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-578576d4-d601-4944-b544-f2ab0743fdd0 tempest-SnapshotsActionsTest-495057273 None] Acquiring lock "cinder-1e2462e2-fd87-48c1-bdd9-82a833ed8e9e-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:44 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-578576d4-d601-4944-b544-f2ab0743fdd0 tempest-SnapshotsActionsTest-495057273 None] Lock "cinder-1e2462e2-fd87-48c1-bdd9-82a833ed8e9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:44 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-578576d4-d601-4944-b544-f2ab0743fdd0 tempest-SnapshotsActionsTest-495057273 None] Acquiring lock "cinder-quobyte-17e88016-e75c-4e89-8de7-11aca84188fc" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:44 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-578576d4-d601-4944-b544-f2ab0743fdd0 tempest-SnapshotsActionsTest-495057273 None] Lock "cinder-quobyte-17e88016-e75c-4e89-8de7-11aca84188fc" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:44 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-578576d4-d601-4944-b544-f2ab0743fdd0 tempest-SnapshotsActionsTest-495057273 None] Acquiring lock "cinder-quobyte-1e2462e2-fd87-48c1-bdd9-82a833ed8e9e" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:44 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-578576d4-d601-4944-b544-f2ab0743fdd0 tempest-SnapshotsActionsTest-495057273 None] Lock "cinder-quobyte-1e2462e2-fd87-48c1-bdd9-82a833ed8e9e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-578576d4-d601-4944-b544-f2ab0743fdd0 tempest-SnapshotsActionsTest-495057273 None] Deleting offline snapshot 1e2462e2-fd87-48c1-bdd9-82a833ed8e9e of volume 17e88016-e75c-4e89-8de7-11aca84188fc {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:45:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-578576d4-d601-4944-b544-f2ab0743fdd0 tempest-SnapshotsActionsTest-495057273 None] snapshot_file for this snap is: volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:45:44 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb1ad1d-9a9f-49f5-ad81-a709cd8f2a51]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-578576d4-d601-4944-b544-f2ab0743fdd0 tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:44 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e Jul 17 19:45:44 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:44 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-578576d4-d601-4944-b544-f2ab0743fdd0 tempest-SnapshotsActionsTest-495057273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e" returned: 0 in 0.439s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-578576d4-d601-4944-b544-f2ab0743fdd0 tempest-SnapshotsActionsTest-495057273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17e88016-e75c-4e89-8de7-11aca84188fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:45:44 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c65ad4-6140-4150-9f18-a7362f0a7590]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-578576d4-d601-4944-b544-f2ab0743fdd0 tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:45 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc Jul 17 19:45:45 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:45 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-578576d4-d601-4944-b544-f2ab0743fdd0 tempest-SnapshotsActionsTest-495057273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc" returned: 0 in 0.473s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-578576d4-d601-4944-b544-f2ab0743fdd0 tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:45 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e Jul 17 19:45:45 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:45 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-578576d4-d601-4944-b544-f2ab0743fdd0 tempest-SnapshotsActionsTest-495057273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e" returned: 0 in 0.487s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-578576d4-d601-4944-b544-f2ab0743fdd0 tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:45 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e Jul 17 19:45:45 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:46 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-578576d4-d601-4944-b544-f2ab0743fdd0 tempest-SnapshotsActionsTest-495057273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc.1e2462e2-fd87-48c1-bdd9-82a833ed8e9e" returned: 0 in 0.282s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-578576d4-d601-4944-b544-f2ab0743fdd0 tempest-SnapshotsActionsTest-495057273 None] Lock "cinder-quobyte-1e2462e2-fd87-48c1-bdd9-82a833ed8e9e" released by "_delete_snapshot" :: held 1.843s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-578576d4-d601-4944-b544-f2ab0743fdd0 tempest-SnapshotsActionsTest-495057273 None] Lock "cinder-quobyte-17e88016-e75c-4e89-8de7-11aca84188fc" released by "delete_snapshot" :: held 1.870s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:46 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-578576d4-d601-4944-b544-f2ab0743fdd0 tempest-SnapshotsActionsTest-495057273 None] Created reservations ['a25cee4e-2f4e-4f41-98ca-0cd6dcde8392', '6bbe4ddf-f44e-4ea8-acbc-98cbfe63f399', 'a33abd6d-228b-4793-bed6-a39776dffdd1', '78021e20-f844-4846-8087-13059bd2c1f4'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:45:46 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-578576d4-d601-4944-b544-f2ab0743fdd0 tempest-SnapshotsActionsTest-495057273 None] Delete snapshot completed successfully. Jul 17 19:45:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-578576d4-d601-4944-b544-f2ab0743fdd0 tempest-SnapshotsActionsTest-495057273 None] Lock "cinder-1e2462e2-fd87-48c1-bdd9-82a833ed8e9e-delete_snapshot" released by "delete_snapshot" :: held 2.057s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5116d80e-f967-4058-86da-c92367c5c497 tempest-SnapshotsActionsTest-495057273 None] Acquiring lock "cinder-17e88016-e75c-4e89-8de7-11aca84188fc-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5116d80e-f967-4058-86da-c92367c5c497 tempest-SnapshotsActionsTest-495057273 None] Lock "cinder-17e88016-e75c-4e89-8de7-11aca84188fc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5116d80e-f967-4058-86da-c92367c5c497 tempest-SnapshotsActionsTest-495057273 None] Acquiring lock "cinder-quobyte-17e88016-e75c-4e89-8de7-11aca84188fc" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:45:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5116d80e-f967-4058-86da-c92367c5c497 tempest-SnapshotsActionsTest-495057273 None] Lock "cinder-quobyte-17e88016-e75c-4e89-8de7-11aca84188fc" acquired by "delete_volume" :: waited 0.026s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:45:46 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[724ed575-8864-4d28-b467-a681ef6faf53]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:45:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5116d80e-f967-4058-86da-c92367c5c497 tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:46 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc Jul 17 19:45:46 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:47 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5116d80e-f967-4058-86da-c92367c5c497 tempest-SnapshotsActionsTest-495057273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc" returned: 0 in 0.402s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5116d80e-f967-4058-86da-c92367c5c497 tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:47 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc Jul 17 19:45:47 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:47 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5116d80e-f967-4058-86da-c92367c5c497 tempest-SnapshotsActionsTest-495057273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-17e88016-e75c-4e89-8de7-11aca84188fc" returned: 0 in 0.289s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5116d80e-f967-4058-86da-c92367c5c497 tempest-SnapshotsActionsTest-495057273 None] Lock "cinder-quobyte-17e88016-e75c-4e89-8de7-11aca84188fc" released by "delete_volume" :: held 0.773s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:47 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-5116d80e-f967-4058-86da-c92367c5c497 tempest-SnapshotsActionsTest-495057273 None] Created reservations ['92c2e2af-c6a2-4639-a9e6-cf0bb0df82db', 'f10f5190-f406-41b4-a5b0-5992d32e7159', '3d0ee48c-d465-4577-b180-e1b0ad2a0c4a', '1b740271-aa18-49e8-b60b-445b8632b3a6'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:45:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5116d80e-f967-4058-86da-c92367c5c497 tempest-SnapshotsActionsTest-495057273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:45:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5116d80e-f967-4058-86da-c92367c5c497 tempest-SnapshotsActionsTest-495057273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:45:47 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5116d80e-f967-4058-86da-c92367c5c497 tempest-SnapshotsActionsTest-495057273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:45:47 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5116d80e-f967-4058-86da-c92367c5c497 tempest-SnapshotsActionsTest-495057273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:45:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5116d80e-f967-4058-86da-c92367c5c497 tempest-SnapshotsActionsTest-495057273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:45:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5116d80e-f967-4058-86da-c92367c5c497 tempest-SnapshotsActionsTest-495057273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:45:47 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:45:47 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:45:48 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Jul 17 19:45:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5116d80e-f967-4058-86da-c92367c5c497 tempest-SnapshotsActionsTest-495057273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.367s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:45:48 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-5116d80e-f967-4058-86da-c92367c5c497 tempest-SnapshotsActionsTest-495057273 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:45:48 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-5116d80e-f967-4058-86da-c92367c5c497 tempest-SnapshotsActionsTest-495057273 None] Deleted volume successfully. Jul 17 19:45:48 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5116d80e-f967-4058-86da-c92367c5c497 tempest-SnapshotsActionsTest-495057273 None] Lock "cinder-17e88016-e75c-4e89-8de7-11aca84188fc-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:45:57 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:UPDATE=204,cinder:SELECT=174,cinder:INSERT=52,cinder:DELETE=14 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:45:58 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=172,cinder:INSERT=52,cinder:UPDATE=203,cinder:DELETE=19 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:46:06 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:46:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Flow 'volume_create_manager' (df8233a2-00df-4e27-b808-2e4d1c69617b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:46:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf2cb764-58db-4a1d-aeaa-eaa2ecdec31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf2cb764-58db-4a1d-aeaa-eaa2ecdec31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-396626952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fcacb30-ba9f-482e-8565-f490a17f22ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07db7f67f5c14eaea23618a4c06b09f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:46:07Z,use_quota=True,user_id='9b308482253e45bdac8975c14dd90295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67c76b54-588c-472e-83f7-8a993b4b08f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67c76b54-588c-472e-83f7-8a993b4b08f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51920565-8960-41d6-975e-d9cf5ab96ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:06 devstack cinder-volume[87726]: DEBUG cinder.image.glance [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Creating Keystone auth plugin from conf {{(pid=87726) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 19:46:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51920565-8960-41d6-975e-d9cf5ab96ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3fcacb30-ba9f-482e-8565-f490a17f22ea', 'volume_name': 'volume-3fcacb30-ba9f-482e-8565-f490a17f22ea', 'volume_size': 1, 'image_id': '8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f9f36413d75c4b9e8be9b78b4ce9c162', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'created_at': datetime.datetime(2026, 7, 17, 17, 31, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 17, 31, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b96a65ca-9287-4855-a2e5-3da873e480d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b96a65ca-9287-4855-a2e5-3da873e480d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec0f908-6699-4cf9-a2cb-89a5f605923b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:07 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Volume 3fcacb30-ba9f-482e-8565-f490a17f22ea: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3fcacb30-ba9f-482e-8565-f490a17f22ea', 'volume_size': 1, 'image_id': '8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f9f36413d75c4b9e8be9b78b4ce9c162', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'created_at': datetime.datetime(2026, 7, 17, 17, 31, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 17, 31, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 17 19:46:07 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Trying to clone 3fcacb30-ba9f-482e-8565-f490a17f22ea from image 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'metadata': {}}]). {{(pid=87726) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 19:46:07 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_v73_8687devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87726) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 19:46:07 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Image download 20.69 MB at 20.69 MB/s Jul 17 19:46:07 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60bf45a-0746-4bb5-a1d1-77e25b03bdde]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:46:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_v73_8687devstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:07 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_v73_8687devstack@QuobyteHD Jul 17 19:46:07 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:08 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_v73_8687devstack@QuobyteHD" returned: 0 in 0.429s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:08 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Temporary image 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 is fetched for user 9b308482253e45bdac8975c14dd90295. {{(pid=87726) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 19:46:08 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[11be1c03-f782-4afa-9168-b44efde617f2]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:46:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_v73_8687devstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:08 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_v73_8687devstack@QuobyteHD Jul 17 19:46:08 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:08 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_v73_8687devstack@QuobyteHD" returned: 0 in 0.429s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-396626952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fcacb30-ba9f-482e-8565-f490a17f22ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07db7f67f5c14eaea23618a4c06b09f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:46:07Z,use_quota=True,user_id='9b308482253e45bdac8975c14dd90295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:46:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Creating volume 3fcacb30-ba9f-482e-8565-f490a17f22ea {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:46:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:46:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:46:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:46:08 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:46:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3fcacb30-ba9f-482e-8565-f490a17f22ea 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:08 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3fcacb30-ba9f-482e-8565-f490a17f22ea 1073741824 Jul 17 19:46:08 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:09 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3fcacb30-ba9f-482e-8565-f490a17f22ea 1073741824" returned: 0 in 0.529s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3fcacb30-ba9f-482e-8565-f490a17f22ea {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:09 devstack sudo[98158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3fcacb30-ba9f-482e-8565-f490a17f22ea Jul 17 19:46:09 devstack sudo[98158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:09 devstack sudo[98158]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3fcacb30-ba9f-482e-8565-f490a17f22ea" returned: 0 in 0.275s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:46:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:09 devstack cinder-volume[87726]: DEBUG cinder.volume.volume_utils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Attempting download of 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'metadata': {}}])) to volume 3fcacb30-ba9f-482e-8565-f490a17f22ea. {{(pid=87726) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 19:46:09 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[232e7b95-8fb6-42e7-9dc6-ee60d6935aac]: (4, 'raw') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:46:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_wxq0w9yq {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:09 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_wxq0w9yq Jul 17 19:46:09 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:10 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_wxq0w9yq" returned: 0 in 0.359s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_wxq0w9yq {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:10 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_wxq0w9yq Jul 17 19:46:10 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:10 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_wxq0w9yq" returned: 1 in 0.374s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_wxq0w9yq' failed. Not Retrying. {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 19:46:10 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce428505-9f3a-4f60-a880-853a38997d3e]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:46:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_v73_8687devstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:10 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_v73_8687devstack@QuobyteHD Jul 17 19:46:10 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:10 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_v73_8687devstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:10 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 was qcow2, converting to qcow2 {{(pid=87726) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 19:46:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_v73_8687devstack@QuobyteHD /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3fcacb30-ba9f-482e-8565-f490a17f22ea {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:10 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_v73_8687devstack@QuobyteHD /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3fcacb30-ba9f-482e-8565-f490a17f22ea Jul 17 19:46:10 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:12 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:46:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Flow 'volume_create_manager' (e50f736e-9a65-4d67-82c8-cbb6a65a4f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:46:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e4abce-e923-4645-9c44-6c57865d2e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e4abce-e923-4645-9c44-6c57865d2e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2007473680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=233678f5-e6e8-4a3e-ac27-de2fff70410a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecce8ba20c3f4203b8fef4bd78500cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:46:12Z,use_quota=True,user_id='f5abdb9050924bdc93dab42bbe26236e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82a5a1ea-0b4a-434c-9570-f4f542fe3de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82a5a1ea-0b4a-434c-9570-f4f542fe3de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c44aaf-f12f-4738-ac9f-08ec77151e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c44aaf-f12f-4738-ac9f-08ec77151e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '233678f5-e6e8-4a3e-ac27-de2fff70410a', 'volume_name': 'volume-233678f5-e6e8-4a3e-ac27-de2fff70410a', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad2023a-0229-4497-9d14-9143d491f527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad2023a-0229-4497-9d14-9143d491f527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab784c2f-4882-462d-b1c6-6a0ae4efe836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:12 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Volume 233678f5-e6e8-4a3e-ac27-de2fff70410a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-233678f5-e6e8-4a3e-ac27-de2fff70410a', 'volume_size': 1} Jul 17 19:46:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2007473680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=233678f5-e6e8-4a3e-ac27-de2fff70410a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecce8ba20c3f4203b8fef4bd78500cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:46:12Z,use_quota=True,user_id='f5abdb9050924bdc93dab42bbe26236e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:46:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Creating volume 233678f5-e6e8-4a3e-ac27-de2fff70410a {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:46:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:46:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:46:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:46:12 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:46:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-233678f5-e6e8-4a3e-ac27-de2fff70410a 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:12 devstack sudo[98184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-233678f5-e6e8-4a3e-ac27-de2fff70410a 1073741824 Jul 17 19:46:12 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:13 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-233678f5-e6e8-4a3e-ac27-de2fff70410a 1073741824" returned: 0 in 0.500s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-233678f5-e6e8-4a3e-ac27-de2fff70410a {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:13 devstack sudo[98190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-233678f5-e6e8-4a3e-ac27-de2fff70410a Jul 17 19:46:13 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:13 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_v73_8687devstack@QuobyteHD /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3fcacb30-ba9f-482e-8565-f490a17f22ea" returned: 0 in 2.366s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:13 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_v73_8687devstack@QuobyteHD, size 112.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3fcacb30-ba9f-482e-8565-f490a17f22ea {{(pid=87726) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 19:46:13 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Converted 112.00 MB image at 47.31 MB/s Jul 17 19:46:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3fcacb30-ba9f-482e-8565-f490a17f22ea 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:13 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3fcacb30-ba9f-482e-8565-f490a17f22ea 1G Jul 17 19:46:13 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:13 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-233678f5-e6e8-4a3e-ac27-de2fff70410a" returned: 0 in 0.288s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:13 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:46:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab784c2f-4882-462d-b1c6-6a0ae4efe836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-233678f5-e6e8-4a3e-ac27-de2fff70410a', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a8500a1-4822-405d-a17a-557b101b3750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:13 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Volume volume-233678f5-e6e8-4a3e-ac27-de2fff70410a (233678f5-e6e8-4a3e-ac27-de2fff70410a): created successfully Jul 17 19:46:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a8500a1-4822-405d-a17a-557b101b3750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Flow 'volume_create_manager' (e50f736e-9a65-4d67-82c8-cbb6a65a4f75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:46:13 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-b5d1c632-45cf-4d34-a256-9109f8f61066 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Created volume successfully. Jul 17 19:46:13 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3fcacb30-ba9f-482e-8565-f490a17f22ea 1G" returned: 0 in 0.359s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:13 devstack cinder-volume[87726]: DEBUG cinder.volume.volume_utils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Downloaded image 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'metadata': {}}])) to volume 3fcacb30-ba9f-482e-8565-f490a17f22ea successfully. {{(pid=87726) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 19:46:13 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Temporary image 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 for user 9b308482253e45bdac8975c14dd90295 is deleted. {{(pid=87726) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 19:46:13 devstack cinder-volume[87726]: DEBUG cinder.volume.volume_utils [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Marking volume 3fcacb30-ba9f-482e-8565-f490a17f22ea as bootable. {{(pid=87726) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 19:46:13 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Copying metadata from image 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 to 3fcacb30-ba9f-482e-8565-f490a17f22ea. {{(pid=87726) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 19:46:13 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Creating volume glance metadata for volume 3fcacb30-ba9f-482e-8565-f490a17f22ea backed by image 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87726) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 19:46:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec0f908-6699-4cf9-a2cb-89a5f605923b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fcacb30-ba9f-482e-8565-f490a17f22ea', 'volume_size': 1, 'image_id': '8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f9f36413d75c4b9e8be9b78b4ce9c162', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'created_at': datetime.datetime(2026, 7, 17, 17, 31, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 17, 31, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d5013ea-3268-4391-aa1c-26ae1bdbd185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:13 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Volume volume-3fcacb30-ba9f-482e-8565-f490a17f22ea (3fcacb30-ba9f-482e-8565-f490a17f22ea): created successfully Jul 17 19:46:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d5013ea-3268-4391-aa1c-26ae1bdbd185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Flow 'volume_create_manager' (df8233a2-00df-4e27-b808-2e4d1c69617b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:46:13 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-a9972f1e-813b-403a-bc86-c4a56d57e613 tempest-VolumesImageMetadata-181890879 None] Created volume successfully. Jul 17 19:46:14 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e3b5da0d-de7f-4f47-906d-855a36780ecf tempest-VolumeQuotasAdminTestJSON-1428292990 None] Acquiring lock "cinder-233678f5-e6e8-4a3e-ac27-de2fff70410a-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:46:14 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e3b5da0d-de7f-4f47-906d-855a36780ecf tempest-VolumeQuotasAdminTestJSON-1428292990 None] Lock "cinder-233678f5-e6e8-4a3e-ac27-de2fff70410a-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:46:14 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-45a059bd-353c-40e7-94d9-25f2e452ac7a tempest-VolumesImageMetadata-181890879 None] Acquiring lock "cinder-3fcacb30-ba9f-482e-8565-f490a17f22ea-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:46:14 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-45a059bd-353c-40e7-94d9-25f2e452ac7a tempest-VolumesImageMetadata-181890879 None] Lock "cinder-3fcacb30-ba9f-482e-8565-f490a17f22ea-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:46:14 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e3b5da0d-de7f-4f47-906d-855a36780ecf tempest-VolumeQuotasAdminTestJSON-1428292990 None] Acquiring lock "cinder-quobyte-233678f5-e6e8-4a3e-ac27-de2fff70410a" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:46:14 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-45a059bd-353c-40e7-94d9-25f2e452ac7a tempest-VolumesImageMetadata-181890879 None] Acquiring lock "cinder-quobyte-3fcacb30-ba9f-482e-8565-f490a17f22ea" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:46:14 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e3b5da0d-de7f-4f47-906d-855a36780ecf tempest-VolumeQuotasAdminTestJSON-1428292990 None] Lock "cinder-quobyte-233678f5-e6e8-4a3e-ac27-de2fff70410a" acquired by "delete_volume" :: waited 0.033s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:46:14 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-45a059bd-353c-40e7-94d9-25f2e452ac7a tempest-VolumesImageMetadata-181890879 None] Lock "cinder-quobyte-3fcacb30-ba9f-482e-8565-f490a17f22ea" acquired by "delete_volume" :: waited 0.032s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:46:14 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf0b6c3-873b-47c2-b430-1ee57d721dc6]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:46:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3b5da0d-de7f-4f47-906d-855a36780ecf tempest-VolumeQuotasAdminTestJSON-1428292990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-233678f5-e6e8-4a3e-ac27-de2fff70410a {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:14 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[da55bea2-0693-408d-932f-8aafc3f7e943]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:46:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-45a059bd-353c-40e7-94d9-25f2e452ac7a tempest-VolumesImageMetadata-181890879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3fcacb30-ba9f-482e-8565-f490a17f22ea {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:14 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-233678f5-e6e8-4a3e-ac27-de2fff70410a Jul 17 19:46:14 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:14 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3fcacb30-ba9f-482e-8565-f490a17f22ea Jul 17 19:46:14 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:15 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3b5da0d-de7f-4f47-906d-855a36780ecf tempest-VolumeQuotasAdminTestJSON-1428292990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-233678f5-e6e8-4a3e-ac27-de2fff70410a" returned: 0 in 0.386s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3b5da0d-de7f-4f47-906d-855a36780ecf tempest-VolumeQuotasAdminTestJSON-1428292990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-233678f5-e6e8-4a3e-ac27-de2fff70410a {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:15 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-45a059bd-353c-40e7-94d9-25f2e452ac7a tempest-VolumesImageMetadata-181890879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3fcacb30-ba9f-482e-8565-f490a17f22ea" returned: 0 in 0.377s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-45a059bd-353c-40e7-94d9-25f2e452ac7a tempest-VolumesImageMetadata-181890879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3fcacb30-ba9f-482e-8565-f490a17f22ea {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:15 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-233678f5-e6e8-4a3e-ac27-de2fff70410a Jul 17 19:46:15 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:15 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3fcacb30-ba9f-482e-8565-f490a17f22ea Jul 17 19:46:15 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:15 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:46:15 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:15 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3b5da0d-de7f-4f47-906d-855a36780ecf tempest-VolumeQuotasAdminTestJSON-1428292990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-233678f5-e6e8-4a3e-ac27-de2fff70410a" returned: 0 in 0.324s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e3b5da0d-de7f-4f47-906d-855a36780ecf tempest-VolumeQuotasAdminTestJSON-1428292990 None] Lock "cinder-quobyte-233678f5-e6e8-4a3e-ac27-de2fff70410a" released by "delete_volume" :: held 0.770s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:46:15 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-45a059bd-353c-40e7-94d9-25f2e452ac7a tempest-VolumesImageMetadata-181890879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3fcacb30-ba9f-482e-8565-f490a17f22ea" returned: 0 in 0.336s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-45a059bd-353c-40e7-94d9-25f2e452ac7a tempest-VolumesImageMetadata-181890879 None] Lock "cinder-quobyte-3fcacb30-ba9f-482e-8565-f490a17f22ea" released by "delete_volume" :: held 0.770s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-e3b5da0d-de7f-4f47-906d-855a36780ecf tempest-VolumeQuotasAdminTestJSON-1428292990 None] Created reservations ['a9c2e4b2-21a0-4fd9-b9c2-91cfe183a6d1', '31a52038-3bf2-44f0-ad98-5b71e68f09a8', '2feec770-aa07-4182-948d-68e95aeb50a2', 'e5430174-6787-450f-90f9-90779f072fd9'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:46:15 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-45a059bd-353c-40e7-94d9-25f2e452ac7a tempest-VolumesImageMetadata-181890879 None] Created reservations ['d3bdbaa8-d0ec-4590-a30b-04b0a0032974', '6f038fe9-0045-49f2-9fb1-f4a23bf34064', 'd3f663c1-f701-4180-8bdf-92a7a892100e', 'dedb9a24-c7d1-419c-9989-0143a1c2b756'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.311s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager._thread_info {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread count: 28 {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread info: [<_MainThread(MainThread, started 130066227544192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e3b5da0d-de7f-4f47-906d-855a36780ecf tempest-VolumeQuotasAdminTestJSON-1428292990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e3b5da0d-de7f-4f47-906d-855a36780ecf tempest-VolumeQuotasAdminTestJSON-1428292990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e3b5da0d-de7f-4f47-906d-855a36780ecf tempest-VolumeQuotasAdminTestJSON-1428292990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e3b5da0d-de7f-4f47-906d-855a36780ecf tempest-VolumeQuotasAdminTestJSON-1428292990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e3b5da0d-de7f-4f47-906d-855a36780ecf tempest-VolumeQuotasAdminTestJSON-1428292990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3b5da0d-de7f-4f47-906d-855a36780ecf tempest-VolumeQuotasAdminTestJSON-1428292990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-45a059bd-353c-40e7-94d9-25f2e452ac7a tempest-VolumesImageMetadata-181890879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-45a059bd-353c-40e7-94d9-25f2e452ac7a tempest-VolumesImageMetadata-181890879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-45a059bd-353c-40e7-94d9-25f2e452ac7a tempest-VolumesImageMetadata-181890879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:46:15 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:46:15 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-45a059bd-353c-40e7-94d9-25f2e452ac7a tempest-VolumesImageMetadata-181890879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-45a059bd-353c-40e7-94d9-25f2e452ac7a tempest-VolumesImageMetadata-181890879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-45a059bd-353c-40e7-94d9-25f2e452ac7a tempest-VolumesImageMetadata-181890879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:15 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:46:15 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:16 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3b5da0d-de7f-4f47-906d-855a36780ecf tempest-VolumeQuotasAdminTestJSON-1428292990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.367s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:16 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-e3b5da0d-de7f-4f47-906d-855a36780ecf tempest-VolumeQuotasAdminTestJSON-1428292990 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:46:16 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e3b5da0d-de7f-4f47-906d-855a36780ecf tempest-VolumeQuotasAdminTestJSON-1428292990 None] Deleted volume successfully. Jul 17 19:46:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e3b5da0d-de7f-4f47-906d-855a36780ecf tempest-VolumeQuotasAdminTestJSON-1428292990 None] Lock "cinder-233678f5-e6e8-4a3e-ac27-de2fff70410a-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:46:16 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-45a059bd-353c-40e7-94d9-25f2e452ac7a tempest-VolumesImageMetadata-181890879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.376s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:16 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-45a059bd-353c-40e7-94d9-25f2e452ac7a tempest-VolumesImageMetadata-181890879 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:46:16 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-45a059bd-353c-40e7-94d9-25f2e452ac7a tempest-VolumesImageMetadata-181890879 None] Deleted volume successfully. Jul 17 19:46:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-45a059bd-353c-40e7-94d9-25f2e452ac7a tempest-VolumesImageMetadata-181890879 None] Lock "cinder-3fcacb30-ba9f-482e-8565-f490a17f22ea-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:46:16 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:46:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Flow 'volume_create_manager' (9dc4abec-b587-4a55-ab7b-3c4bfa512b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:46:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaece2be-0d6e-4c97-b2d7-c3218211a5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaece2be-0d6e-4c97-b2d7-c3218211a5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-254213141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e844fc-1cbf-4814-8cbe-35136c8d8574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecce8ba20c3f4203b8fef4bd78500cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:46:17Z,use_quota=True,user_id='f5abdb9050924bdc93dab42bbe26236e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa196618-0b3c-48a9-a80e-0f38e838a2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa196618-0b3c-48a9-a80e-0f38e838a2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2adefac3-6f2d-4e41-a756-4114a638ad24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2adefac3-6f2d-4e41-a756-4114a638ad24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10e844fc-1cbf-4814-8cbe-35136c8d8574', 'volume_name': 'volume-10e844fc-1cbf-4814-8cbe-35136c8d8574', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c50d6c1d-2c13-46e9-b1d5-b08be79bee59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c50d6c1d-2c13-46e9-b1d5-b08be79bee59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2517d2c-76cc-4f76-b75d-dfd136c22545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:16 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Volume 10e844fc-1cbf-4814-8cbe-35136c8d8574: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10e844fc-1cbf-4814-8cbe-35136c8d8574', 'volume_size': 1} Jul 17 19:46:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:16 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-254213141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e844fc-1cbf-4814-8cbe-35136c8d8574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecce8ba20c3f4203b8fef4bd78500cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:46:17Z,use_quota=True,user_id='f5abdb9050924bdc93dab42bbe26236e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:46:16 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Creating volume 10e844fc-1cbf-4814-8cbe-35136c8d8574 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:46:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:16 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:46:16 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:46:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:16 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:46:16 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:46:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-10e844fc-1cbf-4814-8cbe-35136c8d8574 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:16 devstack sudo[98228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-10e844fc-1cbf-4814-8cbe-35136c8d8574 1073741824 Jul 17 19:46:16 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:17 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-10e844fc-1cbf-4814-8cbe-35136c8d8574 1073741824" returned: 0 in 0.569s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-10e844fc-1cbf-4814-8cbe-35136c8d8574 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:17 devstack sudo[98234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-10e844fc-1cbf-4814-8cbe-35136c8d8574 Jul 17 19:46:17 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:17 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-10e844fc-1cbf-4814-8cbe-35136c8d8574" returned: 0 in 0.370s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:17 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:46:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2517d2c-76cc-4f76-b75d-dfd136c22545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10e844fc-1cbf-4814-8cbe-35136c8d8574', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7943efe-9af3-40c0-819a-21befb2d4a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:17 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Volume volume-10e844fc-1cbf-4814-8cbe-35136c8d8574 (10e844fc-1cbf-4814-8cbe-35136c8d8574): created successfully Jul 17 19:46:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7943efe-9af3-40c0-819a-21befb2d4a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Flow 'volume_create_manager' (9dc4abec-b587-4a55-ab7b-3c4bfa512b51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:46:17 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-dda594e7-7826-43ee-afe0-75549b3ffe49 tempest-VolumeQuotasAdminTestJSON-1428292990 None] Created volume successfully. Jul 17 19:46:19 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-9bf41319-a755-4e04-9047-795a3da47893 tempest-VolumeQuotasAdminTestJSON-1829602815 None] Transfer volume completed successfully. Jul 17 19:46:20 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-43144755-ad2d-499d-a084-228774934cdb tempest-VolumeQuotasAdminTestJSON-1751243810 None] Acquiring lock "cinder-10e844fc-1cbf-4814-8cbe-35136c8d8574-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:46:20 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-43144755-ad2d-499d-a084-228774934cdb tempest-VolumeQuotasAdminTestJSON-1751243810 None] Lock "cinder-10e844fc-1cbf-4814-8cbe-35136c8d8574-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:46:20 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-43144755-ad2d-499d-a084-228774934cdb tempest-VolumeQuotasAdminTestJSON-1751243810 None] Acquiring lock "cinder-quobyte-10e844fc-1cbf-4814-8cbe-35136c8d8574" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:46:20 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-43144755-ad2d-499d-a084-228774934cdb tempest-VolumeQuotasAdminTestJSON-1751243810 None] Lock "cinder-quobyte-10e844fc-1cbf-4814-8cbe-35136c8d8574" acquired by "delete_volume" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:46:20 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[49285e23-9f71-4377-8208-3476a3c97b77]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:46:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-43144755-ad2d-499d-a084-228774934cdb tempest-VolumeQuotasAdminTestJSON-1751243810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-10e844fc-1cbf-4814-8cbe-35136c8d8574 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:20 devstack sudo[98273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-10e844fc-1cbf-4814-8cbe-35136c8d8574 Jul 17 19:46:20 devstack sudo[98273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:20 devstack sudo[98273]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-43144755-ad2d-499d-a084-228774934cdb tempest-VolumeQuotasAdminTestJSON-1751243810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-10e844fc-1cbf-4814-8cbe-35136c8d8574" returned: 0 in 0.409s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-43144755-ad2d-499d-a084-228774934cdb tempest-VolumeQuotasAdminTestJSON-1751243810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-10e844fc-1cbf-4814-8cbe-35136c8d8574 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:21 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-10e844fc-1cbf-4814-8cbe-35136c8d8574 Jul 17 19:46:21 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:21 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-43144755-ad2d-499d-a084-228774934cdb tempest-VolumeQuotasAdminTestJSON-1751243810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-10e844fc-1cbf-4814-8cbe-35136c8d8574" returned: 0 in 0.546s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:21 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-43144755-ad2d-499d-a084-228774934cdb tempest-VolumeQuotasAdminTestJSON-1751243810 None] Lock "cinder-quobyte-10e844fc-1cbf-4814-8cbe-35136c8d8574" released by "delete_volume" :: held 1.017s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:46:21 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-43144755-ad2d-499d-a084-228774934cdb tempest-VolumeQuotasAdminTestJSON-1751243810 None] Created reservations ['82b26f70-df9a-4baf-967d-a44c408780c4', '5f5c7f20-4c06-458a-8789-84cb1a636b67', '67b01aae-ef89-4c35-b1d5-67a1d9ec9738', '8fdb695f-863c-4668-9d88-3d250f63551f'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:46:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-43144755-ad2d-499d-a084-228774934cdb tempest-VolumeQuotasAdminTestJSON-1751243810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-43144755-ad2d-499d-a084-228774934cdb tempest-VolumeQuotasAdminTestJSON-1751243810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-43144755-ad2d-499d-a084-228774934cdb tempest-VolumeQuotasAdminTestJSON-1751243810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:46:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-43144755-ad2d-499d-a084-228774934cdb tempest-VolumeQuotasAdminTestJSON-1751243810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:46:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-43144755-ad2d-499d-a084-228774934cdb tempest-VolumeQuotasAdminTestJSON-1751243810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-43144755-ad2d-499d-a084-228774934cdb tempest-VolumeQuotasAdminTestJSON-1751243810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:21 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:46:21 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:22 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:46:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] Flow 'volume_create_manager' (a7cfebd2-eb91-40e4-a252-d10b80c52304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:46:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (613b863d-a438-4abb-9645-e35c33c1d0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (613b863d-a438-4abb-9645-e35c33c1d0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1784356879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c08f89-fe6a-4bbd-b593-98b0b22632f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebea3b6bad6b4db18d07a8b8cc952555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:46:22Z,use_quota=True,user_id='dccfd7f9c3034a05a75c6ce115077651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e2494d5-9cc3-4084-b783-04cb71f75caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e2494d5-9cc3-4084-b783-04cb71f75caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5437fc-03a6-48be-a30e-354ac0f566dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5437fc-03a6-48be-a30e-354ac0f566dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78c08f89-fe6a-4bbd-b593-98b0b22632f6', 'volume_name': 'volume-78c08f89-fe6a-4bbd-b593-98b0b22632f6', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c43835b4-f8dd-43c6-ab92-b8b01d0f50d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c43835b4-f8dd-43c6-ab92-b8b01d0f50d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23bd2fe1-0391-4e53-bd5f-11cc2938adb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:22 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] Volume 78c08f89-fe6a-4bbd-b593-98b0b22632f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78c08f89-fe6a-4bbd-b593-98b0b22632f6', 'volume_size': 1} Jul 17 19:46:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1784356879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c08f89-fe6a-4bbd-b593-98b0b22632f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebea3b6bad6b4db18d07a8b8cc952555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:46:22Z,use_quota=True,user_id='dccfd7f9c3034a05a75c6ce115077651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:46:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] Creating volume 78c08f89-fe6a-4bbd-b593-98b0b22632f6 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:46:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:46:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:46:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:46:22 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:46:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-78c08f89-fe6a-4bbd-b593-98b0b22632f6 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:22 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-78c08f89-fe6a-4bbd-b593-98b0b22632f6 1073741824 Jul 17 19:46:22 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:22 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-43144755-ad2d-499d-a084-228774934cdb tempest-VolumeQuotasAdminTestJSON-1751243810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.484s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:22 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-43144755-ad2d-499d-a084-228774934cdb tempest-VolumeQuotasAdminTestJSON-1751243810 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:46:22 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-43144755-ad2d-499d-a084-228774934cdb tempest-VolumeQuotasAdminTestJSON-1751243810 None] Deleted volume successfully. Jul 17 19:46:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-43144755-ad2d-499d-a084-228774934cdb tempest-VolumeQuotasAdminTestJSON-1751243810 None] Lock "cinder-10e844fc-1cbf-4814-8cbe-35136c8d8574-delete_volume" released by "delete_volume" :: held 1.937s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:46:22 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-78c08f89-fe6a-4bbd-b593-98b0b22632f6 1073741824" returned: 0 in 0.483s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-78c08f89-fe6a-4bbd-b593-98b0b22632f6 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:22 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-78c08f89-fe6a-4bbd-b593-98b0b22632f6 Jul 17 19:46:22 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:23 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-78c08f89-fe6a-4bbd-b593-98b0b22632f6" returned: 0 in 0.400s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:46:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23bd2fe1-0391-4e53-bd5f-11cc2938adb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78c08f89-fe6a-4bbd-b593-98b0b22632f6', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a72565c-020d-4523-b0dc-fe690f8b45a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:23 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] Volume volume-78c08f89-fe6a-4bbd-b593-98b0b22632f6 (78c08f89-fe6a-4bbd-b593-98b0b22632f6): created successfully Jul 17 19:46:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a72565c-020d-4523-b0dc-fe690f8b45a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] Flow 'volume_create_manager' (a7cfebd2-eb91-40e4-a252-d10b80c52304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:46:23 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-97bdf5c7-5cf3-44e7-9021-c70cb6cace4d tempest-VolumesTransfersV357Test-1023894167 None] Created volume successfully. Jul 17 19:46:25 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e7e7bfa1-bdac-4e84-8163-332dd6437bb7 tempest-VolumesTransfersV357Test-514625059 None] Transfer volume completed successfully. Jul 17 19:46:25 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:46:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] Flow 'volume_create_manager' (3de1d063-26fa-4069-8b0d-8ebe4181c309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:46:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b70a686a-4a2c-4d92-b591-818ce077bc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b70a686a-4a2c-4d92-b591-818ce077bc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-376525921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c86b6b7f-4024-48c6-8584-04d1164ce50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e497e2856f4c90b82a39b0dedf0346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:46:25Z,use_quota=True,user_id='e1c9c2613dcc46f88bc94891d503c38e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbb7cb60-1368-4078-aa61-9f7372859d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbb7cb60-1368-4078-aa61-9f7372859d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2137fd27-af55-457b-b81d-ab0f87035b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2137fd27-af55-457b-b81d-ab0f87035b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c86b6b7f-4024-48c6-8584-04d1164ce50f', 'volume_name': 'volume-c86b6b7f-4024-48c6-8584-04d1164ce50f', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d0f40c-e902-4428-9008-dc66eaf5022f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d0f40c-e902-4428-9008-dc66eaf5022f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c05fc46-02c3-417b-9099-8224506270ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:25 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] Volume c86b6b7f-4024-48c6-8584-04d1164ce50f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c86b6b7f-4024-48c6-8584-04d1164ce50f', 'volume_size': 1} Jul 17 19:46:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-376525921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c86b6b7f-4024-48c6-8584-04d1164ce50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e497e2856f4c90b82a39b0dedf0346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:46:25Z,use_quota=True,user_id='e1c9c2613dcc46f88bc94891d503c38e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:46:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] Creating volume c86b6b7f-4024-48c6-8584-04d1164ce50f {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:46:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:46:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:46:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:46:25 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:46:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c86b6b7f-4024-48c6-8584-04d1164ce50f 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:25 devstack sudo[98363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c86b6b7f-4024-48c6-8584-04d1164ce50f 1073741824 Jul 17 19:46:25 devstack sudo[98363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-352ce373-c5fb-491d-9887-a1b79e717a5d tempest-VolumesTransfersV357Test-964648595 None] Acquiring lock "cinder-78c08f89-fe6a-4bbd-b593-98b0b22632f6-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:46:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-352ce373-c5fb-491d-9887-a1b79e717a5d tempest-VolumesTransfersV357Test-964648595 None] Lock "cinder-78c08f89-fe6a-4bbd-b593-98b0b22632f6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:46:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-352ce373-c5fb-491d-9887-a1b79e717a5d tempest-VolumesTransfersV357Test-964648595 None] Acquiring lock "cinder-quobyte-78c08f89-fe6a-4bbd-b593-98b0b22632f6" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:46:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-352ce373-c5fb-491d-9887-a1b79e717a5d tempest-VolumesTransfersV357Test-964648595 None] Lock "cinder-quobyte-78c08f89-fe6a-4bbd-b593-98b0b22632f6" acquired by "delete_volume" :: waited 0.029s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:46:26 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39e54e0-fc3e-4082-8782-9062c25dd0e4]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:46:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-352ce373-c5fb-491d-9887-a1b79e717a5d tempest-VolumesTransfersV357Test-964648595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-78c08f89-fe6a-4bbd-b593-98b0b22632f6 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:26 devstack sudo[98363]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c86b6b7f-4024-48c6-8584-04d1164ce50f 1073741824" returned: 0 in 0.694s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c86b6b7f-4024-48c6-8584-04d1164ce50f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:26 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-78c08f89-fe6a-4bbd-b593-98b0b22632f6 Jul 17 19:46:26 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:26 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c86b6b7f-4024-48c6-8584-04d1164ce50f Jul 17 19:46:26 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:26 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-352ce373-c5fb-491d-9887-a1b79e717a5d tempest-VolumesTransfersV357Test-964648595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-78c08f89-fe6a-4bbd-b593-98b0b22632f6" returned: 0 in 0.528s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-352ce373-c5fb-491d-9887-a1b79e717a5d tempest-VolumesTransfersV357Test-964648595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-78c08f89-fe6a-4bbd-b593-98b0b22632f6 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:26 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c86b6b7f-4024-48c6-8584-04d1164ce50f" returned: 0 in 0.409s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:26 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:46:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:26 devstack sudo[98378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-78c08f89-fe6a-4bbd-b593-98b0b22632f6 Jul 17 19:46:26 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c05fc46-02c3-417b-9099-8224506270ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c86b6b7f-4024-48c6-8584-04d1164ce50f', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5680f786-c5c9-4bc7-9165-e10d4070c46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:26 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] Volume volume-c86b6b7f-4024-48c6-8584-04d1164ce50f (c86b6b7f-4024-48c6-8584-04d1164ce50f): created successfully Jul 17 19:46:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5680f786-c5c9-4bc7-9165-e10d4070c46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] Flow 'volume_create_manager' (3de1d063-26fa-4069-8b0d-8ebe4181c309) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:46:26 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-8886ce6f-f017-478c-9bf4-2b1aba5154c9 tempest-TestMinimumBasicScenario-1186437048 None] Created volume successfully. Jul 17 19:46:27 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-352ce373-c5fb-491d-9887-a1b79e717a5d tempest-VolumesTransfersV357Test-964648595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-78c08f89-fe6a-4bbd-b593-98b0b22632f6" returned: 0 in 0.307s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-352ce373-c5fb-491d-9887-a1b79e717a5d tempest-VolumesTransfersV357Test-964648595 None] Lock "cinder-quobyte-78c08f89-fe6a-4bbd-b593-98b0b22632f6" released by "delete_volume" :: held 0.894s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:46:27 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-352ce373-c5fb-491d-9887-a1b79e717a5d tempest-VolumesTransfersV357Test-964648595 None] Created reservations ['c7b37a6c-a805-4c1d-9380-9ea1f2f50db8', 'cb970d71-d909-4a54-8fb4-55bf3d72a084', 'a286f28d-c78c-4913-8621-dde71767e415', 'b93c7037-5071-45e0-a595-a5a3ffeaf71c'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:46:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-352ce373-c5fb-491d-9887-a1b79e717a5d tempest-VolumesTransfersV357Test-964648595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-352ce373-c5fb-491d-9887-a1b79e717a5d tempest-VolumesTransfersV357Test-964648595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:27 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-352ce373-c5fb-491d-9887-a1b79e717a5d tempest-VolumesTransfersV357Test-964648595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:46:27 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-352ce373-c5fb-491d-9887-a1b79e717a5d tempest-VolumesTransfersV357Test-964648595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:46:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-352ce373-c5fb-491d-9887-a1b79e717a5d tempest-VolumesTransfersV357Test-964648595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-352ce373-c5fb-491d-9887-a1b79e717a5d tempest-VolumesTransfersV357Test-964648595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:27 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:46:27 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:27 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-352ce373-c5fb-491d-9887-a1b79e717a5d tempest-VolumesTransfersV357Test-964648595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.589s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:27 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-352ce373-c5fb-491d-9887-a1b79e717a5d tempest-VolumesTransfersV357Test-964648595 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:46:27 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-352ce373-c5fb-491d-9887-a1b79e717a5d tempest-VolumesTransfersV357Test-964648595 None] Deleted volume successfully. Jul 17 19:46:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-352ce373-c5fb-491d-9887-a1b79e717a5d tempest-VolumesTransfersV357Test-964648595 None] Lock "cinder-78c08f89-fe6a-4bbd-b593-98b0b22632f6-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:46:28 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:46:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] Flow 'volume_create_manager' (825dfc4d-f8a1-44d6-ac5b-179c46373af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:46:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5347c7e9-6616-47ef-9e48-21cc52bb27cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5347c7e9-6616-47ef-9e48-21cc52bb27cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2006613054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d678b0fd-8693-40c9-a523-12558ca8d1d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebea3b6bad6b4db18d07a8b8cc952555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:46:28Z,use_quota=True,user_id='dccfd7f9c3034a05a75c6ce115077651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (882a2e61-9950-4590-a8ee-0d81dce33093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (882a2e61-9950-4590-a8ee-0d81dce33093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27aa4ab9-0424-4bc0-9590-c776db937659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27aa4ab9-0424-4bc0-9590-c776db937659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd678b0fd-8693-40c9-a523-12558ca8d1d4', 'volume_name': 'volume-d678b0fd-8693-40c9-a523-12558ca8d1d4', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb89f956-7da3-4860-aafc-fc4f3135a0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb89f956-7da3-4860-aafc-fc4f3135a0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:28 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (966b1623-1dcf-4815-8a18-ed2c98d75a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:28 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] Volume d678b0fd-8693-40c9-a523-12558ca8d1d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d678b0fd-8693-40c9-a523-12558ca8d1d4', 'volume_size': 1} Jul 17 19:46:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2006613054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d678b0fd-8693-40c9-a523-12558ca8d1d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebea3b6bad6b4db18d07a8b8cc952555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:46:28Z,use_quota=True,user_id='dccfd7f9c3034a05a75c6ce115077651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:46:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] Creating volume d678b0fd-8693-40c9-a523-12558ca8d1d4 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:46:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:46:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:46:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:46:28 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:46:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d678b0fd-8693-40c9-a523-12558ca8d1d4 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:28 devstack sudo[98384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d678b0fd-8693-40c9-a523-12558ca8d1d4 1073741824 Jul 17 19:46:28 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:29 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d678b0fd-8693-40c9-a523-12558ca8d1d4 1073741824" returned: 0 in 0.775s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d678b0fd-8693-40c9-a523-12558ca8d1d4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:29 devstack sudo[98401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d678b0fd-8693-40c9-a523-12558ca8d1d4 Jul 17 19:46:29 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-013f2e1d-85ef-40dc-912a-b558afab5a64 req-80ec9893-92b1-4366-8d1e-505188058d48 tempest-TestMinimumBasicScenario-1186437048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:29 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d678b0fd-8693-40c9-a523-12558ca8d1d4" returned: 0 in 0.303s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:29 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:46:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-013f2e1d-85ef-40dc-912a-b558afab5a64 req-80ec9893-92b1-4366-8d1e-505188058d48 tempest-TestMinimumBasicScenario-1186437048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.109s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:29 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (966b1623-1dcf-4815-8a18-ed2c98d75a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d678b0fd-8693-40c9-a523-12558ca8d1d4', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:29 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61e4d18a-d01b-4115-98b8-449fc747ef37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-013f2e1d-85ef-40dc-912a-b558afab5a64 req-80ec9893-92b1-4366-8d1e-505188058d48 tempest-TestMinimumBasicScenario-1186437048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.056s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:29 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] Volume volume-d678b0fd-8693-40c9-a523-12558ca8d1d4 (d678b0fd-8693-40c9-a523-12558ca8d1d4): created successfully Jul 17 19:46:29 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61e4d18a-d01b-4115-98b8-449fc747ef37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:29 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] Flow 'volume_create_manager' (825dfc4d-f8a1-44d6-ac5b-179c46373af8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:46:29 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-435d6bb0-1fbf-4cfc-8a40-6f61ec560bef tempest-VolumesTransfersV357Test-1023894167 None] Created volume successfully. Jul 17 19:46:29 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-013f2e1d-85ef-40dc-912a-b558afab5a64 req-80ec9893-92b1-4366-8d1e-505188058d48 tempest-TestMinimumBasicScenario-1186437048 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55', 'name': 'volume-c86b6b7f-4024-48c6-8584-04d1164ce50f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7b2de800-6013-4402-a6b0-3981bc0e4add', 'enforce_multipath': True} {{(pid=87726) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 19:46:29 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-013f2e1d-85ef-40dc-912a-b558afab5a64 req-80ec9893-92b1-4366-8d1e-505188058d48 tempest-TestMinimumBasicScenario-1186437048 None] attachment_update completed successfully. Jul 17 19:46:30 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c889940f-cb9c-483e-958a-7218056d16dd tempest-VolumesTransfersV357Test-964648595 None] Acquiring lock "cinder-d678b0fd-8693-40c9-a523-12558ca8d1d4-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:46:30 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c889940f-cb9c-483e-958a-7218056d16dd tempest-VolumesTransfersV357Test-964648595 None] Lock "cinder-d678b0fd-8693-40c9-a523-12558ca8d1d4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:46:30 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c889940f-cb9c-483e-958a-7218056d16dd tempest-VolumesTransfersV357Test-964648595 None] Acquiring lock "cinder-quobyte-d678b0fd-8693-40c9-a523-12558ca8d1d4" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:46:30 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c889940f-cb9c-483e-958a-7218056d16dd tempest-VolumesTransfersV357Test-964648595 None] Lock "cinder-quobyte-d678b0fd-8693-40c9-a523-12558ca8d1d4" acquired by "delete_volume" :: waited 0.033s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:46:30 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f8b37c-3f0f-4bfb-9adb-0a661a3a3f00]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:46:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c889940f-cb9c-483e-958a-7218056d16dd tempest-VolumesTransfersV357Test-964648595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d678b0fd-8693-40c9-a523-12558ca8d1d4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:30 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d678b0fd-8693-40c9-a523-12558ca8d1d4 Jul 17 19:46:30 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:31 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c889940f-cb9c-483e-958a-7218056d16dd tempest-VolumesTransfersV357Test-964648595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d678b0fd-8693-40c9-a523-12558ca8d1d4" returned: 0 in 0.399s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c889940f-cb9c-483e-958a-7218056d16dd tempest-VolumesTransfersV357Test-964648595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d678b0fd-8693-40c9-a523-12558ca8d1d4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:31 devstack sudo[98792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d678b0fd-8693-40c9-a523-12558ca8d1d4 Jul 17 19:46:31 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:31 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c889940f-cb9c-483e-958a-7218056d16dd tempest-VolumesTransfersV357Test-964648595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d678b0fd-8693-40c9-a523-12558ca8d1d4" returned: 0 in 0.296s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:31 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c889940f-cb9c-483e-958a-7218056d16dd tempest-VolumesTransfersV357Test-964648595 None] Lock "cinder-quobyte-d678b0fd-8693-40c9-a523-12558ca8d1d4" released by "delete_volume" :: held 0.758s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:46:31 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-c889940f-cb9c-483e-958a-7218056d16dd tempest-VolumesTransfersV357Test-964648595 None] Created reservations ['6dcefa45-07c2-421d-9268-5aacab407c49', 'c914c365-fc01-4905-9d4a-0d3c64ea2538', 'cb61cb76-9a50-4377-adaf-d38523e9d5e4', '559c6bf5-3019-43c7-a6bb-3cf542429b3f'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:46:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c889940f-cb9c-483e-958a-7218056d16dd tempest-VolumesTransfersV357Test-964648595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c889940f-cb9c-483e-958a-7218056d16dd tempest-VolumesTransfersV357Test-964648595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c889940f-cb9c-483e-958a-7218056d16dd tempest-VolumesTransfersV357Test-964648595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:46:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c889940f-cb9c-483e-958a-7218056d16dd tempest-VolumesTransfersV357Test-964648595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:46:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c889940f-cb9c-483e-958a-7218056d16dd tempest-VolumesTransfersV357Test-964648595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c889940f-cb9c-483e-958a-7218056d16dd tempest-VolumesTransfersV357Test-964648595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:31 devstack sudo[98795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:46:31 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:32 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c889940f-cb9c-483e-958a-7218056d16dd tempest-VolumesTransfersV357Test-964648595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.390s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:32 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-c889940f-cb9c-483e-958a-7218056d16dd tempest-VolumesTransfersV357Test-964648595 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:46:32 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-c889940f-cb9c-483e-958a-7218056d16dd tempest-VolumesTransfersV357Test-964648595 None] Deleted volume successfully. Jul 17 19:46:32 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c889940f-cb9c-483e-958a-7218056d16dd tempest-VolumesTransfersV357Test-964648595 None] Lock "cinder-d678b0fd-8693-40c9-a523-12558ca8d1d4-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:46:32 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:46:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Flow 'volume_create_manager' (ba990df2-2bac-45c2-bdbc-ae7f556ef0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:46:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2512b72d-d8dd-4c34-8540-71af9527bad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2512b72d-d8dd-4c34-8540-71af9527bad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1356081843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1247881-9e35-4fd5-a2f4-78bfc38d8088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cd9ac7fafa74289b9f68a83bc97fa9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:46:33Z,use_quota=True,user_id='2e2f91f02bae4b028f51daa72fd1e1ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (895a75fd-8374-4020-afaf-32c7c0ee64b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (895a75fd-8374-4020-afaf-32c7c0ee64b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc614eb3-acc9-4ed9-89f5-6cf5376aa22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc614eb3-acc9-4ed9-89f5-6cf5376aa22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1247881-9e35-4fd5-a2f4-78bfc38d8088', 'volume_name': 'volume-e1247881-9e35-4fd5-a2f4-78bfc38d8088', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c9233c-eba7-4445-b1d7-133fd246c6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c9233c-eba7-4445-b1d7-133fd246c6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fda5be7-173d-4752-99a3-edbda057ebf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:32 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Volume e1247881-9e35-4fd5-a2f4-78bfc38d8088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1247881-9e35-4fd5-a2f4-78bfc38d8088', 'volume_size': 1} Jul 17 19:46:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:32 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1356081843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1247881-9e35-4fd5-a2f4-78bfc38d8088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cd9ac7fafa74289b9f68a83bc97fa9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:46:33Z,use_quota=True,user_id='2e2f91f02bae4b028f51daa72fd1e1ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:46:32 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Creating volume e1247881-9e35-4fd5-a2f4-78bfc38d8088 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:46:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:32 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:46:32 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:46:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:32 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:46:32 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:46:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-e1247881-9e35-4fd5-a2f4-78bfc38d8088 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:32 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-e1247881-9e35-4fd5-a2f4-78bfc38d8088 1073741824 Jul 17 19:46:32 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:33 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-e1247881-9e35-4fd5-a2f4-78bfc38d8088 1073741824" returned: 0 in 0.576s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-e1247881-9e35-4fd5-a2f4-78bfc38d8088 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:33 devstack sudo[98805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-e1247881-9e35-4fd5-a2f4-78bfc38d8088 Jul 17 19:46:33 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:33 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-e1247881-9e35-4fd5-a2f4-78bfc38d8088" returned: 0 in 0.449s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:46:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fda5be7-173d-4752-99a3-edbda057ebf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1247881-9e35-4fd5-a2f4-78bfc38d8088', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac2c5b2-5d2b-4f90-a5e5-a85c58058d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:33 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Volume volume-e1247881-9e35-4fd5-a2f4-78bfc38d8088 (e1247881-9e35-4fd5-a2f4-78bfc38d8088): created successfully Jul 17 19:46:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac2c5b2-5d2b-4f90-a5e5-a85c58058d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Flow 'volume_create_manager' (ba990df2-2bac-45c2-bdbc-ae7f556ef0f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:46:34 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-8afe5b63-7446-4918-b5e7-96d4db001ed7 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Created volume successfully. Jul 17 19:46:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6e64491c-a77b-4fea-a317-78e6dfec06d9 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Acquiring lock "cinder-e1247881-9e35-4fd5-a2f4-78bfc38d8088-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:46:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6e64491c-a77b-4fea-a317-78e6dfec06d9 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Lock "cinder-e1247881-9e35-4fd5-a2f4-78bfc38d8088-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:46:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6e64491c-a77b-4fea-a317-78e6dfec06d9 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Acquiring lock "cinder-quobyte-e1247881-9e35-4fd5-a2f4-78bfc38d8088" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:46:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6e64491c-a77b-4fea-a317-78e6dfec06d9 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Lock "cinder-quobyte-e1247881-9e35-4fd5-a2f4-78bfc38d8088" acquired by "delete_volume" :: waited 0.021s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:46:36 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00fbf9e-1b37-4620-bbe9-045803e37e20]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:46:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e64491c-a77b-4fea-a317-78e6dfec06d9 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-e1247881-9e35-4fd5-a2f4-78bfc38d8088 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:36 devstack sudo[98850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-e1247881-9e35-4fd5-a2f4-78bfc38d8088 Jul 17 19:46:36 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:37 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e64491c-a77b-4fea-a317-78e6dfec06d9 tempest-VolumeQuotasNegativeTestJSON-880684319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-e1247881-9e35-4fd5-a2f4-78bfc38d8088" returned: 0 in 0.481s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e64491c-a77b-4fea-a317-78e6dfec06d9 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-e1247881-9e35-4fd5-a2f4-78bfc38d8088 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:37 devstack sudo[98855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-e1247881-9e35-4fd5-a2f4-78bfc38d8088 Jul 17 19:46:37 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:37 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e64491c-a77b-4fea-a317-78e6dfec06d9 tempest-VolumeQuotasNegativeTestJSON-880684319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-e1247881-9e35-4fd5-a2f4-78bfc38d8088" returned: 0 in 0.345s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6e64491c-a77b-4fea-a317-78e6dfec06d9 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Lock "cinder-quobyte-e1247881-9e35-4fd5-a2f4-78bfc38d8088" released by "delete_volume" :: held 0.894s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:46:37 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-6e64491c-a77b-4fea-a317-78e6dfec06d9 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Created reservations ['d93b974e-d52e-48cd-934e-07add033faa4', '89adaf96-5762-443e-9e98-13763cf47a03', '444e28b0-3c8b-4f44-ba23-03c2e5ad761e', '27116699-6c12-4159-8b6f-b59ee618cdbb'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:46:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6e64491c-a77b-4fea-a317-78e6dfec06d9 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6e64491c-a77b-4fea-a317-78e6dfec06d9 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6e64491c-a77b-4fea-a317-78e6dfec06d9 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:46:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6e64491c-a77b-4fea-a317-78e6dfec06d9 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:46:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6e64491c-a77b-4fea-a317-78e6dfec06d9 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e64491c-a77b-4fea-a317-78e6dfec06d9 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:37 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:46:37 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:38 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e64491c-a77b-4fea-a317-78e6dfec06d9 tempest-VolumeQuotasNegativeTestJSON-880684319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.353s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:38 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-6e64491c-a77b-4fea-a317-78e6dfec06d9 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:46:38 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-6e64491c-a77b-4fea-a317-78e6dfec06d9 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Deleted volume successfully. Jul 17 19:46:38 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6e64491c-a77b-4fea-a317-78e6dfec06d9 tempest-VolumeQuotasNegativeTestJSON-880684319 None] Lock "cinder-e1247881-9e35-4fd5-a2f4-78bfc38d8088-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:46:42 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:46:42 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] Flow 'volume_create_manager' (e6c4e595-1229-41df-ad50-841522183146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:46:42 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (381e4af3-7a15-42a3-96b9-f6dc67da7792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:42 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (381e4af3-7a15-42a3-96b9-f6dc67da7792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1047213841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b9be757-3055-4b8c-a068-3cef21fd8d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef397287c20d4a5abe93761e5413d9d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:46:42Z,use_quota=True,user_id='f8f535f8b67641609c8ac1f2cce4c3cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:42 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e600a8d-9f7b-4217-9b0f-dc898d672a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:42 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e600a8d-9f7b-4217-9b0f-dc898d672a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:42 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13ca821c-dfef-4369-a460-a15e67e675fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:42 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13ca821c-dfef-4369-a460-a15e67e675fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b9be757-3055-4b8c-a068-3cef21fd8d1f', 'volume_name': 'volume-1b9be757-3055-4b8c-a068-3cef21fd8d1f', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:42 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff4de176-ab3b-46ae-8b39-46253a84a299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:42 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff4de176-ab3b-46ae-8b39-46253a84a299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:42 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dace09a5-ca93-4907-8e10-b6755a59d127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:42 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] Volume 1b9be757-3055-4b8c-a068-3cef21fd8d1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b9be757-3055-4b8c-a068-3cef21fd8d1f', 'volume_size': 1} Jul 17 19:46:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:42 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1047213841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b9be757-3055-4b8c-a068-3cef21fd8d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef397287c20d4a5abe93761e5413d9d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:46:42Z,use_quota=True,user_id='f8f535f8b67641609c8ac1f2cce4c3cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:46:42 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] Creating volume 1b9be757-3055-4b8c-a068-3cef21fd8d1f {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:46:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:42 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:46:42 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:46:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:42 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:46:42 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:46:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1b9be757-3055-4b8c-a068-3cef21fd8d1f 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:42 devstack sudo[98863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1b9be757-3055-4b8c-a068-3cef21fd8d1f 1073741824 Jul 17 19:46:42 devstack sudo[98863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:42 devstack sudo[98863]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1b9be757-3055-4b8c-a068-3cef21fd8d1f 1073741824" returned: 0 in 0.502s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1b9be757-3055-4b8c-a068-3cef21fd8d1f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:43 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1b9be757-3055-4b8c-a068-3cef21fd8d1f Jul 17 19:46:43 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:43 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1b9be757-3055-4b8c-a068-3cef21fd8d1f" returned: 0 in 0.302s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:43 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:46:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:43 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dace09a5-ca93-4907-8e10-b6755a59d127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b9be757-3055-4b8c-a068-3cef21fd8d1f', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:43 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b34d5d-4fe8-48d0-8d7d-85a8893f809d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:43 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] Volume volume-1b9be757-3055-4b8c-a068-3cef21fd8d1f (1b9be757-3055-4b8c-a068-3cef21fd8d1f): created successfully Jul 17 19:46:43 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b34d5d-4fe8-48d0-8d7d-85a8893f809d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:43 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] Flow 'volume_create_manager' (e6c4e595-1229-41df-ad50-841522183146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:46:43 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-ca1b21c2-c488-44a4-a70a-1d496ad27462 tempest-VolumesNegativeTest-823015792 None] Created volume successfully. Jul 17 19:46:43 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:46:43 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Flow 'volume_create_manager' (5ca41979-c99b-49b0-91a4-ae6e7d587642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:46:43 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb90c6b-8768-4cf1-8933-2ac535fd716d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:43 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb90c6b-8768-4cf1-8933-2ac535fd716d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1895936118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a651155-94bd-447c-bd76-c41ebc138a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31d8d3c9e1de4c659400ebd9719c17e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:46:44Z,use_quota=True,user_id='b2e16a9d85254f71a7c1129d037266b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f588c50d-4508-41d6-b64f-e98a264b7370),volume_type_id=f588c50d-4508-41d6-b64f-e98a264b7370)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:43 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d24d947-10be-4b79-bfd0-4482b6528781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:43 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d24d947-10be-4b79-bfd0-4482b6528781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:43 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eeec40b-d13f-4a3b-916d-b146bf5457bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:43 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eeec40b-d13f-4a3b-916d-b146bf5457bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a651155-94bd-447c-bd76-c41ebc138a17', 'volume_name': 'volume-7a651155-94bd-447c-bd76-c41ebc138a17', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:43 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d64ac3a-ca27-4fac-9d91-36c209acfb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:43 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d64ac3a-ca27-4fac-9d91-36c209acfb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:43 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db35185b-d9c5-4f56-aa27-3b4b7d920aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:43 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Volume 7a651155-94bd-447c-bd76-c41ebc138a17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a651155-94bd-447c-bd76-c41ebc138a17', 'volume_size': 1} Jul 17 19:46:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:43 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1895936118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a651155-94bd-447c-bd76-c41ebc138a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31d8d3c9e1de4c659400ebd9719c17e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:46:44Z,use_quota=True,user_id='b2e16a9d85254f71a7c1129d037266b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f588c50d-4508-41d6-b64f-e98a264b7370),volume_type_id=f588c50d-4508-41d6-b64f-e98a264b7370)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:46:43 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Creating volume 7a651155-94bd-447c-bd76-c41ebc138a17 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:46:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:43 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:46:43 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:46:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:43 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:46:43 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:46:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7a651155-94bd-447c-bd76-c41ebc138a17 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:43 devstack sudo[98872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7a651155-94bd-447c-bd76-c41ebc138a17 1073741824 Jul 17 19:46:43 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:44 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7a651155-94bd-447c-bd76-c41ebc138a17 1073741824" returned: 0 in 0.417s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7a651155-94bd-447c-bd76-c41ebc138a17 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:44 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7a651155-94bd-447c-bd76-c41ebc138a17 Jul 17 19:46:44 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:44 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7a651155-94bd-447c-bd76-c41ebc138a17" returned: 0 in 0.309s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:46:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db35185b-d9c5-4f56-aa27-3b4b7d920aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a651155-94bd-447c-bd76-c41ebc138a17', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a269968e-f138-42de-8ccd-435d443ed6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:44 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Volume volume-7a651155-94bd-447c-bd76-c41ebc138a17 (7a651155-94bd-447c-bd76-c41ebc138a17): created successfully Jul 17 19:46:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a269968e-f138-42de-8ccd-435d443ed6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Flow 'volume_create_manager' (5ca41979-c99b-49b0-91a4-ae6e7d587642) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:46:44 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-ca9b6ffa-93e8-4ed7-b570-b6b473d069cd tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Created volume successfully. Jul 17 19:46:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-eb99aebf-9134-4235-97bf-5dbbbea5453e tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-eb99aebf-9134-4235-97bf-5dbbbea5453e tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:45 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-eb99aebf-9134-4235-97bf-5dbbbea5453e tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:46:45 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-eb99aebf-9134-4235-97bf-5dbbbea5453e tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:46:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-eb99aebf-9134-4235-97bf-5dbbbea5453e tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-eb99aebf-9134-4235-97bf-5dbbbea5453e tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:45 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:46:45 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:45 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-eb99aebf-9134-4235-97bf-5dbbbea5453e tempest-VolumeRetypeWithoutMigrationTest-553649250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.284s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:45 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-eb99aebf-9134-4235-97bf-5dbbbea5453e tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:46:45 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-eb99aebf-9134-4235-97bf-5dbbbea5453e tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Retype volume completed successfully. Jul 17 19:46:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-470d4fc9-1abb-426b-8fa5-58815b7dfc73 tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Acquiring lock "cinder-7a651155-94bd-447c-bd76-c41ebc138a17-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:46:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-470d4fc9-1abb-426b-8fa5-58815b7dfc73 tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Lock "cinder-7a651155-94bd-447c-bd76-c41ebc138a17-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:46:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-470d4fc9-1abb-426b-8fa5-58815b7dfc73 tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Acquiring lock "cinder-quobyte-7a651155-94bd-447c-bd76-c41ebc138a17" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:46:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-470d4fc9-1abb-426b-8fa5-58815b7dfc73 tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Lock "cinder-quobyte-7a651155-94bd-447c-bd76-c41ebc138a17" acquired by "delete_volume" :: waited 0.024s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:46:46 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[e830a752-b6a9-43d3-8bd0-0d2e6afd581c]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:46:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-470d4fc9-1abb-426b-8fa5-58815b7dfc73 tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7a651155-94bd-447c-bd76-c41ebc138a17 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:46 devstack sudo[98888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7a651155-94bd-447c-bd76-c41ebc138a17 Jul 17 19:46:46 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:47 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-470d4fc9-1abb-426b-8fa5-58815b7dfc73 tempest-VolumeRetypeWithoutMigrationTest-553649250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7a651155-94bd-447c-bd76-c41ebc138a17" returned: 0 in 0.422s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-470d4fc9-1abb-426b-8fa5-58815b7dfc73 tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7a651155-94bd-447c-bd76-c41ebc138a17 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:47 devstack sudo[98893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7a651155-94bd-447c-bd76-c41ebc138a17 Jul 17 19:46:47 devstack sudo[98893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:47 devstack sudo[98893]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-470d4fc9-1abb-426b-8fa5-58815b7dfc73 tempest-VolumeRetypeWithoutMigrationTest-553649250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7a651155-94bd-447c-bd76-c41ebc138a17" returned: 0 in 0.278s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-470d4fc9-1abb-426b-8fa5-58815b7dfc73 tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Lock "cinder-quobyte-7a651155-94bd-447c-bd76-c41ebc138a17" released by "delete_volume" :: held 0.757s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:46:47 devstack cinder-volume[87726]: WARNING cinder.quota [None req-470d4fc9-1abb-426b-8fa5-58815b7dfc73 tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:46:47 devstack cinder-volume[87726]: WARNING cinder.quota [None req-470d4fc9-1abb-426b-8fa5-58815b7dfc73 tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:46:47 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-470d4fc9-1abb-426b-8fa5-58815b7dfc73 tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Created reservations ['04e523b9-5f02-46ea-bb74-aa4503710229', 'a77bd59b-86b3-409d-88b9-25fd9d13cfec', '0d4191c1-2bc5-4e06-b456-f8e7d33d2a91', 'fe823771-01e6-4200-9c62-f5553ab2e8b7'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:46:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-470d4fc9-1abb-426b-8fa5-58815b7dfc73 tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-470d4fc9-1abb-426b-8fa5-58815b7dfc73 tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:47 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-470d4fc9-1abb-426b-8fa5-58815b7dfc73 tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:46:47 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-470d4fc9-1abb-426b-8fa5-58815b7dfc73 tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:46:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-470d4fc9-1abb-426b-8fa5-58815b7dfc73 tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-470d4fc9-1abb-426b-8fa5-58815b7dfc73 tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:47 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:46:47 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:48 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-470d4fc9-1abb-426b-8fa5-58815b7dfc73 tempest-VolumeRetypeWithoutMigrationTest-553649250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.396s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:48 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-470d4fc9-1abb-426b-8fa5-58815b7dfc73 tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:46:48 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-470d4fc9-1abb-426b-8fa5-58815b7dfc73 tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Deleted volume successfully. Jul 17 19:46:48 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-470d4fc9-1abb-426b-8fa5-58815b7dfc73 tempest-VolumeRetypeWithoutMigrationTest-553649250 None] Lock "cinder-7a651155-94bd-447c-bd76-c41ebc138a17-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:46:56 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:46:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] Flow 'volume_create_manager' (b5228cc3-068b-42a6-a873-d23632b6a0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:46:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c705fe-541f-4e3e-bd9b-486ca988e2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c705fe-541f-4e3e-bd9b-486ca988e2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-948959689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89e5d010-335a-4232-8a88-2c09b0819cc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b512ed04fd94145b60c1c5de836f1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:46:56Z,use_quota=True,user_id='e9084ae3dce34a809d3702fb3f175ddc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8dfffd8-1e61-419e-a084-6cc8145b0185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8dfffd8-1e61-419e-a084-6cc8145b0185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d1ea9d-806f-476d-8a61-046956b5cc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d1ea9d-806f-476d-8a61-046956b5cc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89e5d010-335a-4232-8a88-2c09b0819cc8', 'volume_name': 'volume-89e5d010-335a-4232-8a88-2c09b0819cc8', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e981f665-da45-4584-8652-471e2f4ca52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e981f665-da45-4584-8652-471e2f4ca52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b199194f-6d3f-4f4d-b049-3b534b89122d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:56 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] Volume 89e5d010-335a-4232-8a88-2c09b0819cc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89e5d010-335a-4232-8a88-2c09b0819cc8', 'volume_size': 1} Jul 17 19:46:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:56 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-948959689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89e5d010-335a-4232-8a88-2c09b0819cc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b512ed04fd94145b60c1c5de836f1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:46:56Z,use_quota=True,user_id='e9084ae3dce34a809d3702fb3f175ddc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:46:56 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] Creating volume 89e5d010-335a-4232-8a88-2c09b0819cc8 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:46:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:56 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:46:56 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:46:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:56 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:46:56 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:46:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-89e5d010-335a-4232-8a88-2c09b0819cc8 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:56 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-89e5d010-335a-4232-8a88-2c09b0819cc8 1073741824 Jul 17 19:46:56 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:56 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-89e5d010-335a-4232-8a88-2c09b0819cc8 1073741824" returned: 0 in 0.506s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-89e5d010-335a-4232-8a88-2c09b0819cc8 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:56 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-89e5d010-335a-4232-8a88-2c09b0819cc8 Jul 17 19:46:56 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:57 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-89e5d010-335a-4232-8a88-2c09b0819cc8" returned: 0 in 0.283s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:57 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:46:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b199194f-6d3f-4f4d-b049-3b534b89122d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89e5d010-335a-4232-8a88-2c09b0819cc8', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b9c766-dffc-43f2-8c0e-1888652351cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:46:57 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] Volume volume-89e5d010-335a-4232-8a88-2c09b0819cc8 (89e5d010-335a-4232-8a88-2c09b0819cc8): created successfully Jul 17 19:46:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b9c766-dffc-43f2-8c0e-1888652351cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:46:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] Flow 'volume_create_manager' (b5228cc3-068b-42a6-a873-d23632b6a0ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:46:57 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-11f2f23e-90dc-423a-92a9-6a74d662f904 tempest-VolumesServicesTestJSON-626763106 None] Created volume successfully. Jul 17 19:46:58 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7c217468-beb5-4657-a763-9d371815a097 tempest-VolumesServicesTestJSON-626763106 None] Acquiring lock "cinder-89e5d010-335a-4232-8a88-2c09b0819cc8-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:46:58 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7c217468-beb5-4657-a763-9d371815a097 tempest-VolumesServicesTestJSON-626763106 None] Lock "cinder-89e5d010-335a-4232-8a88-2c09b0819cc8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:46:58 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:UPDATE=98,cinder:SELECT=77,cinder:INSERT=28,cinder:DELETE=7 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:46:58 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=79,cinder:UPDATE=91,cinder:INSERT=23,cinder:DELETE=10 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:46:58 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7c217468-beb5-4657-a763-9d371815a097 tempest-VolumesServicesTestJSON-626763106 None] Acquiring lock "cinder-quobyte-89e5d010-335a-4232-8a88-2c09b0819cc8" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:46:58 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7c217468-beb5-4657-a763-9d371815a097 tempest-VolumesServicesTestJSON-626763106 None] Lock "cinder-quobyte-89e5d010-335a-4232-8a88-2c09b0819cc8" acquired by "delete_volume" :: waited 0.045s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:46:58 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e943e61-a063-4174-a580-78c79d972d89]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:46:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7c217468-beb5-4657-a763-9d371815a097 tempest-VolumesServicesTestJSON-626763106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-89e5d010-335a-4232-8a88-2c09b0819cc8 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:58 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-89e5d010-335a-4232-8a88-2c09b0819cc8 Jul 17 19:46:58 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:58 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7c217468-beb5-4657-a763-9d371815a097 tempest-VolumesServicesTestJSON-626763106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-89e5d010-335a-4232-8a88-2c09b0819cc8" returned: 0 in 0.467s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7c217468-beb5-4657-a763-9d371815a097 tempest-VolumesServicesTestJSON-626763106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-89e5d010-335a-4232-8a88-2c09b0819cc8 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:59 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-89e5d010-335a-4232-8a88-2c09b0819cc8 Jul 17 19:46:59 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:59 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7c217468-beb5-4657-a763-9d371815a097 tempest-VolumesServicesTestJSON-626763106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-89e5d010-335a-4232-8a88-2c09b0819cc8" returned: 0 in 0.319s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:59 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7c217468-beb5-4657-a763-9d371815a097 tempest-VolumesServicesTestJSON-626763106 None] Lock "cinder-quobyte-89e5d010-335a-4232-8a88-2c09b0819cc8" released by "delete_volume" :: held 0.836s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:46:59 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-7c217468-beb5-4657-a763-9d371815a097 tempest-VolumesServicesTestJSON-626763106 None] Created reservations ['a620882a-eb62-4311-9401-dfefb5196d87', '98c992f6-3b69-4d2c-aede-62ec4e00969a', '606816b4-61b3-4d21-b734-76f949cba8d8', 'e5e7cc02-8b32-42b9-af5c-faebbbda9f7c'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:46:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7c217468-beb5-4657-a763-9d371815a097 tempest-VolumesServicesTestJSON-626763106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:46:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7c217468-beb5-4657-a763-9d371815a097 tempest-VolumesServicesTestJSON-626763106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:46:59 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7c217468-beb5-4657-a763-9d371815a097 tempest-VolumesServicesTestJSON-626763106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:46:59 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7c217468-beb5-4657-a763-9d371815a097 tempest-VolumesServicesTestJSON-626763106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:46:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7c217468-beb5-4657-a763-9d371815a097 tempest-VolumesServicesTestJSON-626763106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:46:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7c217468-beb5-4657-a763-9d371815a097 tempest-VolumesServicesTestJSON-626763106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:46:59 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:46:59 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:46:59 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Jul 17 19:46:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7c217468-beb5-4657-a763-9d371815a097 tempest-VolumesServicesTestJSON-626763106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.356s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:46:59 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-7c217468-beb5-4657-a763-9d371815a097 tempest-VolumesServicesTestJSON-626763106 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:46:59 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-7c217468-beb5-4657-a763-9d371815a097 tempest-VolumesServicesTestJSON-626763106 None] Deleted volume successfully. Jul 17 19:46:59 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7c217468-beb5-4657-a763-9d371815a097 tempest-VolumesServicesTestJSON-626763106 None] Lock "cinder-89e5d010-335a-4232-8a88-2c09b0819cc8-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:04 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-8aa2ca7f-ee68-42f3-8235-465d987fef00 tempest-VolumesNegativeTest-823015792 None] Acquiring lock "cinder-1b9be757-3055-4b8c-a068-3cef21fd8d1f-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:04 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-8aa2ca7f-ee68-42f3-8235-465d987fef00 tempest-VolumesNegativeTest-823015792 None] Lock "cinder-1b9be757-3055-4b8c-a068-3cef21fd8d1f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:04 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-8aa2ca7f-ee68-42f3-8235-465d987fef00 tempest-VolumesNegativeTest-823015792 None] Acquiring lock "cinder-quobyte-1b9be757-3055-4b8c-a068-3cef21fd8d1f" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:04 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-8aa2ca7f-ee68-42f3-8235-465d987fef00 tempest-VolumesNegativeTest-823015792 None] Lock "cinder-quobyte-1b9be757-3055-4b8c-a068-3cef21fd8d1f" acquired by "delete_volume" :: waited 0.019s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:04 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65df632-30bd-4373-a8b7-d4686052edc7]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:47:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8aa2ca7f-ee68-42f3-8235-465d987fef00 tempest-VolumesNegativeTest-823015792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1b9be757-3055-4b8c-a068-3cef21fd8d1f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:04 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1b9be757-3055-4b8c-a068-3cef21fd8d1f Jul 17 19:47:04 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:04 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8aa2ca7f-ee68-42f3-8235-465d987fef00 tempest-VolumesNegativeTest-823015792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1b9be757-3055-4b8c-a068-3cef21fd8d1f" returned: 0 in 0.381s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8aa2ca7f-ee68-42f3-8235-465d987fef00 tempest-VolumesNegativeTest-823015792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1b9be757-3055-4b8c-a068-3cef21fd8d1f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:04 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1b9be757-3055-4b8c-a068-3cef21fd8d1f Jul 17 19:47:04 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:05 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8aa2ca7f-ee68-42f3-8235-465d987fef00 tempest-VolumesNegativeTest-823015792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-1b9be757-3055-4b8c-a068-3cef21fd8d1f" returned: 0 in 0.266s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-8aa2ca7f-ee68-42f3-8235-465d987fef00 tempest-VolumesNegativeTest-823015792 None] Lock "cinder-quobyte-1b9be757-3055-4b8c-a068-3cef21fd8d1f" released by "delete_volume" :: held 0.685s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:05 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-8aa2ca7f-ee68-42f3-8235-465d987fef00 tempest-VolumesNegativeTest-823015792 None] Created reservations ['be5e437a-5255-41c7-922e-715c25568d9c', '92ac99cd-ee8f-436e-9c7d-d5ef8e2927c6', 'ded50a0a-8a30-451a-b799-5756e61debb1', 'bbd49db3-c836-45e2-b303-28745c8e7c27'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:47:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8aa2ca7f-ee68-42f3-8235-465d987fef00 tempest-VolumesNegativeTest-823015792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8aa2ca7f-ee68-42f3-8235-465d987fef00 tempest-VolumesNegativeTest-823015792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:05 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8aa2ca7f-ee68-42f3-8235-465d987fef00 tempest-VolumesNegativeTest-823015792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:47:05 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8aa2ca7f-ee68-42f3-8235-465d987fef00 tempest-VolumesNegativeTest-823015792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:47:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8aa2ca7f-ee68-42f3-8235-465d987fef00 tempest-VolumesNegativeTest-823015792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8aa2ca7f-ee68-42f3-8235-465d987fef00 tempest-VolumesNegativeTest-823015792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:05 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:47:05 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:05 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8aa2ca7f-ee68-42f3-8235-465d987fef00 tempest-VolumesNegativeTest-823015792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.271s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:05 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-8aa2ca7f-ee68-42f3-8235-465d987fef00 tempest-VolumesNegativeTest-823015792 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:47:05 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-8aa2ca7f-ee68-42f3-8235-465d987fef00 tempest-VolumesNegativeTest-823015792 None] Deleted volume successfully. Jul 17 19:47:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-8aa2ca7f-ee68-42f3-8235-465d987fef00 tempest-VolumesNegativeTest-823015792 None] Lock "cinder-1b9be757-3055-4b8c-a068-3cef21fd8d1f-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:08 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:47:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] Flow 'volume_create_manager' (38af1ecb-192e-4053-93e0-c160befc7f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:47:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adac2af0-bc28-467d-be7d-568bbd3b6d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adac2af0-bc28-467d-be7d-568bbd3b6d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1556782467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9a703a1-a995-4510-a160-20d9a027d62d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cac4db9d1ff442b58a4690bb4780f91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:47:08Z,use_quota=True,user_id='39d3441f7bb14dfdbeb4a1d5f88c1a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d436f0af-c007-414a-bc67-0c25dc004dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d436f0af-c007-414a-bc67-0c25dc004dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c101f261-923d-4207-82f3-38028bd5196a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c101f261-923d-4207-82f3-38028bd5196a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9a703a1-a995-4510-a160-20d9a027d62d', 'volume_name': 'volume-d9a703a1-a995-4510-a160-20d9a027d62d', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0abd72b8-3ebb-4901-a49a-411c8e41605a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0abd72b8-3ebb-4901-a49a-411c8e41605a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b5c363-f594-48c8-b55c-2d2344d86439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:08 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] Volume d9a703a1-a995-4510-a160-20d9a027d62d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9a703a1-a995-4510-a160-20d9a027d62d', 'volume_size': 1} Jul 17 19:47:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1556782467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9a703a1-a995-4510-a160-20d9a027d62d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cac4db9d1ff442b58a4690bb4780f91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:47:08Z,use_quota=True,user_id='39d3441f7bb14dfdbeb4a1d5f88c1a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:47:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] Creating volume d9a703a1-a995-4510-a160-20d9a027d62d {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:47:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:47:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:47:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:47:08 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:47:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:08 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d 1073741824 Jul 17 19:47:08 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:08 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d 1073741824" returned: 0 in 0.458s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:08 devstack sudo[99157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d Jul 17 19:47:08 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:09 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d" returned: 0 in 0.258s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:47:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b5c363-f594-48c8-b55c-2d2344d86439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9a703a1-a995-4510-a160-20d9a027d62d', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3a3326-73d6-4c14-a763-43ba1ac8e30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:09 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] Volume volume-d9a703a1-a995-4510-a160-20d9a027d62d (d9a703a1-a995-4510-a160-20d9a027d62d): created successfully Jul 17 19:47:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3a3326-73d6-4c14-a763-43ba1ac8e30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] Flow 'volume_create_manager' (38af1ecb-192e-4053-93e0-c160befc7f0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:47:09 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-7615fa9d-693e-4cb9-8d16-0346375613aa tempest-VolumesSnapshotListTestJSON-101223265 None] Created volume successfully. Jul 17 19:47:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-508b10f4-44f2-4178-94a2-5ec4dd8ef680 tempest-VolumesSnapshotListTestJSON-101223265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-508b10f4-44f2-4178-94a2-5ec4dd8ef680 tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-508b10f4-44f2-4178-94a2-5ec4dd8ef680 tempest-VolumesSnapshotListTestJSON-101223265 None] Creating offline snapshot 23535702-c82e-422d-9699-18807c29e400 of volume d9a703a1-a995-4510-a160-20d9a027d62d {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:47:10 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30a3976-d557-4adb-8ba9-ac00c464fd99]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:47:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-508b10f4-44f2-4178-94a2-5ec4dd8ef680 tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:10 devstack sudo[99161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d Jul 17 19:47:10 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:11 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-508b10f4-44f2-4178-94a2-5ec4dd8ef680 tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d" returned: 0 in 0.438s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-508b10f4-44f2-4178-94a2-5ec4dd8ef680 tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:11 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400 1G Jul 17 19:47:11 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:11 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-508b10f4-44f2-4178-94a2-5ec4dd8ef680 tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400 1G" returned: 0 in 0.490s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-508b10f4-44f2-4178-94a2-5ec4dd8ef680 tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9a703a1-a995-4510-a160-20d9a027d62d -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:11 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9a703a1-a995-4510-a160-20d9a027d62d -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400 Jul 17 19:47:11 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:11 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-508b10f4-44f2-4178-94a2-5ec4dd8ef680 tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9a703a1-a995-4510-a160-20d9a027d62d -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400" returned: 0 in 0.356s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:11 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-508b10f4-44f2-4178-94a2-5ec4dd8ef680 tempest-VolumesSnapshotListTestJSON-101223265 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400 is being set with open permissions: ugo+rw Jul 17 19:47:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-508b10f4-44f2-4178-94a2-5ec4dd8ef680 tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:12 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400 Jul 17 19:47:12 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:12 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-508b10f4-44f2-4178-94a2-5ec4dd8ef680 tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400" returned: 0 in 0.257s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-508b10f4-44f2-4178-94a2-5ec4dd8ef680 tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:12 devstack sudo[99180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.info Jul 17 19:47:12 devstack sudo[99180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:12 devstack sudo[99180]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-508b10f4-44f2-4178-94a2-5ec4dd8ef680 tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.info" returned: 0 in 0.270s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:12 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-508b10f4-44f2-4178-94a2-5ec4dd8ef680 tempest-VolumesSnapshotListTestJSON-101223265 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.info is being set with open permissions: ugo+rw Jul 17 19:47:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-508b10f4-44f2-4178-94a2-5ec4dd8ef680 tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:12 devstack sudo[99183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.info Jul 17 19:47:12 devstack sudo[99183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:12 devstack sudo[99183]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-508b10f4-44f2-4178-94a2-5ec4dd8ef680 tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.info" returned: 0 in 0.263s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-508b10f4-44f2-4178-94a2-5ec4dd8ef680 tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.171s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:12 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-508b10f4-44f2-4178-94a2-5ec4dd8ef680 tempest-VolumesSnapshotListTestJSON-101223265 None] Create snapshot completed successfully Jul 17 19:47:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-bc0e7ae4-6194-446f-a337-bf33e6868b42 tempest-VolumesSnapshotListTestJSON-101223265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-bc0e7ae4-6194-446f-a337-bf33e6868b42 tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:14 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-bc0e7ae4-6194-446f-a337-bf33e6868b42 tempest-VolumesSnapshotListTestJSON-101223265 None] Creating offline snapshot e358eee7-f101-43e3-a531-28793ac3430b of volume d9a703a1-a995-4510-a160-20d9a027d62d {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:47:14 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f56d399-0b50-49be-a8a3-c993e3687bda]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:47:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bc0e7ae4-6194-446f-a337-bf33e6868b42 tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:14 devstack sudo[99191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400 Jul 17 19:47:14 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:14 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bc0e7ae4-6194-446f-a337-bf33e6868b42 tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400" returned: 0 in 0.429s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:14 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-bc0e7ae4-6194-446f-a337-bf33e6868b42 tempest-VolumesSnapshotListTestJSON-101223265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9a703a1-a995-4510-a160-20d9a027d62d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:47:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bc0e7ae4-6194-446f-a337-bf33e6868b42 tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:14 devstack sudo[99196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b 1G Jul 17 19:47:14 devstack sudo[99196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:15 devstack sudo[99196]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bc0e7ae4-6194-446f-a337-bf33e6868b42 tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b 1G" returned: 0 in 0.634s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bc0e7ae4-6194-446f-a337-bf33e6868b42 tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:15 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b Jul 17 19:47:15 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:47:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:47:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:47:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:15 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:47:15 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:15 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bc0e7ae4-6194-446f-a337-bf33e6868b42 tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b" returned: 0 in 0.457s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:15 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-bc0e7ae4-6194-446f-a337-bf33e6868b42 tempest-VolumesSnapshotListTestJSON-101223265 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b is being set with open permissions: ugo+rw Jul 17 19:47:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bc0e7ae4-6194-446f-a337-bf33e6868b42 tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:15 devstack sudo[99216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b Jul 17 19:47:15 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.410s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:15 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:47:15 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager._thread_info {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:47:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread count: 28 {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 19:47:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread info: [<_MainThread(MainThread, started 130066227544192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 19:47:16 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bc0e7ae4-6194-446f-a337-bf33e6868b42 tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b" returned: 0 in 0.375s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-bc0e7ae4-6194-446f-a337-bf33e6868b42 tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.052s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:16 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-bc0e7ae4-6194-446f-a337-bf33e6868b42 tempest-VolumesSnapshotListTestJSON-101223265 None] Create snapshot completed successfully Jul 17 19:47:16 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:47:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] Flow 'volume_create_manager' (cfb1aad3-b34c-4a6b-89a0-7537f0a810f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:47:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5417301-45ae-4865-84b5-3212b15a2a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5417301-45ae-4865-84b5-3212b15a2a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-240618378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0b9707-9da9-4c1b-9b29-54e53dfa58a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636ffb0121744020a03c7253347e00f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:47:17Z,use_quota=True,user_id='cc32ebc3d215468d87111ce07bdb978c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd034fe4-f658-49dc-b52c-fb36cdf32624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd034fe4-f658-49dc-b52c-fb36cdf32624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dea5b2c-40f2-4f01-bdfd-01481791df07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dea5b2c-40f2-4f01-bdfd-01481791df07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd0b9707-9da9-4c1b-9b29-54e53dfa58a3', 'volume_name': 'volume-bd0b9707-9da9-4c1b-9b29-54e53dfa58a3', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33f33a8-b8c7-4236-86c5-1bfd70cd1922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33f33a8-b8c7-4236-86c5-1bfd70cd1922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4cc22a7-fd75-4436-bb38-af2cd2cd6278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:16 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] Volume bd0b9707-9da9-4c1b-9b29-54e53dfa58a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd0b9707-9da9-4c1b-9b29-54e53dfa58a3', 'volume_size': 1} Jul 17 19:47:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:16 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-240618378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0b9707-9da9-4c1b-9b29-54e53dfa58a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636ffb0121744020a03c7253347e00f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:47:17Z,use_quota=True,user_id='cc32ebc3d215468d87111ce07bdb978c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:47:16 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] Creating volume bd0b9707-9da9-4c1b-9b29-54e53dfa58a3 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:47:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:16 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:47:16 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:47:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:16 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:47:16 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:47:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bd0b9707-9da9-4c1b-9b29-54e53dfa58a3 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:16 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bd0b9707-9da9-4c1b-9b29-54e53dfa58a3 1073741824 Jul 17 19:47:16 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:17 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-ef6cc706-a9c8-44f1-8c6e-226512b40ed3 req-e7bd4e82-8bed-46ff-90c1-5a60f8d40bad tempest-TestMinimumBasicScenario-1186437048 None] Terminate volume connection completed successfully. Jul 17 19:47:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-ef6cc706-a9c8-44f1-8c6e-226512b40ed3 req-e7bd4e82-8bed-46ff-90c1-5a60f8d40bad tempest-TestMinimumBasicScenario-1186437048 None] Deleting attachment 7b2de800-6013-4402-a6b0-3981bc0e4add. {{(pid=87726) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 19:47:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-bd339c14-8715-4e4b-9c04-76cc6a751a2a tempest-VolumesSnapshotListTestJSON-101223265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:17 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bd0b9707-9da9-4c1b-9b29-54e53dfa58a3 1073741824" returned: 0 in 0.597s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bd0b9707-9da9-4c1b-9b29-54e53dfa58a3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:17 devstack sudo[99233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bd0b9707-9da9-4c1b-9b29-54e53dfa58a3 Jul 17 19:47:17 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:17 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bd0b9707-9da9-4c1b-9b29-54e53dfa58a3" returned: 0 in 0.259s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:17 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:47:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-bd339c14-8715-4e4b-9c04-76cc6a751a2a tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.342s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4cc22a7-fd75-4436-bb38-af2cd2cd6278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd0b9707-9da9-4c1b-9b29-54e53dfa58a3', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d768b3f9-ad69-4106-a7fd-c8d946ffa5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:17 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-bd339c14-8715-4e4b-9c04-76cc6a751a2a tempest-VolumesSnapshotListTestJSON-101223265 None] Creating offline snapshot d2cf4770-e88b-4204-b026-8a860cf5cb82 of volume d9a703a1-a995-4510-a160-20d9a027d62d {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:47:17 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] Volume volume-bd0b9707-9da9-4c1b-9b29-54e53dfa58a3 (bd0b9707-9da9-4c1b-9b29-54e53dfa58a3): created successfully Jul 17 19:47:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d768b3f9-ad69-4106-a7fd-c8d946ffa5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:17 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] Flow 'volume_create_manager' (cfb1aad3-b34c-4a6b-89a0-7537f0a810f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:47:17 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[72718344-d514-48b2-aa65-887c1d8ff06a]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:47:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bd339c14-8715-4e4b-9c04-76cc6a751a2a tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:17 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-31bf818a-4971-4bcd-8da7-25bddb0f15b8 tempest-VolumesListAdminTestJSON-1678900907 None] Created volume successfully. Jul 17 19:47:17 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-01729c2f-1210-445b-859e-0cc3cf88ebf0 tempest-TestMinimumBasicScenario-1186437048 None] Acquiring lock "cinder-c86b6b7f-4024-48c6-8584-04d1164ce50f-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:18 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-01729c2f-1210-445b-859e-0cc3cf88ebf0 tempest-TestMinimumBasicScenario-1186437048 None] Lock "cinder-c86b6b7f-4024-48c6-8584-04d1164ce50f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:18 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b Jul 17 19:47:18 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:18 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-01729c2f-1210-445b-859e-0cc3cf88ebf0 tempest-TestMinimumBasicScenario-1186437048 None] Acquiring lock "cinder-quobyte-c86b6b7f-4024-48c6-8584-04d1164ce50f" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:18 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-01729c2f-1210-445b-859e-0cc3cf88ebf0 tempest-TestMinimumBasicScenario-1186437048 None] Lock "cinder-quobyte-c86b6b7f-4024-48c6-8584-04d1164ce50f" acquired by "delete_volume" :: waited 0.016s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:18 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[71dcfdc5-ce07-46a5-847a-e40bd1d721ce]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:47:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-01729c2f-1210-445b-859e-0cc3cf88ebf0 tempest-TestMinimumBasicScenario-1186437048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c86b6b7f-4024-48c6-8584-04d1164ce50f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:18 devstack sudo[99238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c86b6b7f-4024-48c6-8584-04d1164ce50f Jul 17 19:47:18 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:18 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bd339c14-8715-4e4b-9c04-76cc6a751a2a tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b" returned: 0 in 0.368s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:18 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-bd339c14-8715-4e4b-9c04-76cc6a751a2a tempest-VolumesSnapshotListTestJSON-101223265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9a703a1-a995-4510-a160-20d9a027d62d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:47:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bd339c14-8715-4e4b-9c04-76cc6a751a2a tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.d2cf4770-e88b-4204-b026-8a860cf5cb82 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:18 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.d2cf4770-e88b-4204-b026-8a860cf5cb82 1G Jul 17 19:47:18 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:18 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-01729c2f-1210-445b-859e-0cc3cf88ebf0 tempest-TestMinimumBasicScenario-1186437048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c86b6b7f-4024-48c6-8584-04d1164ce50f" returned: 0 in 0.395s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-01729c2f-1210-445b-859e-0cc3cf88ebf0 tempest-TestMinimumBasicScenario-1186437048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c86b6b7f-4024-48c6-8584-04d1164ce50f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:18 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c86b6b7f-4024-48c6-8584-04d1164ce50f Jul 17 19:47:18 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:18 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-01729c2f-1210-445b-859e-0cc3cf88ebf0 tempest-TestMinimumBasicScenario-1186437048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c86b6b7f-4024-48c6-8584-04d1164ce50f" returned: 0 in 0.281s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:18 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-01729c2f-1210-445b-859e-0cc3cf88ebf0 tempest-TestMinimumBasicScenario-1186437048 None] Lock "cinder-quobyte-c86b6b7f-4024-48c6-8584-04d1164ce50f" released by "delete_volume" :: held 0.722s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:18 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bd339c14-8715-4e4b-9c04-76cc6a751a2a tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.d2cf4770-e88b-4204-b026-8a860cf5cb82 1G" returned: 0 in 0.511s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bd339c14-8715-4e4b-9c04-76cc6a751a2a tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.d2cf4770-e88b-4204-b026-8a860cf5cb82 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:18 devstack sudo[99254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.d2cf4770-e88b-4204-b026-8a860cf5cb82 Jul 17 19:47:18 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:18 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-01729c2f-1210-445b-859e-0cc3cf88ebf0 tempest-TestMinimumBasicScenario-1186437048 None] Created reservations ['320543bc-12d3-479f-a161-cbd961a3703e', '370a50d3-590b-404c-b720-5d6d5ce1a512', '0c1f1f57-54e2-4123-a8bc-08031892a2f5', '1cba011f-4d03-4c4b-82e6-81b85a4d5aa5'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:47:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-01729c2f-1210-445b-859e-0cc3cf88ebf0 tempest-TestMinimumBasicScenario-1186437048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-01729c2f-1210-445b-859e-0cc3cf88ebf0 tempest-TestMinimumBasicScenario-1186437048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:18 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-01729c2f-1210-445b-859e-0cc3cf88ebf0 tempest-TestMinimumBasicScenario-1186437048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:47:18 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-01729c2f-1210-445b-859e-0cc3cf88ebf0 tempest-TestMinimumBasicScenario-1186437048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:47:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-01729c2f-1210-445b-859e-0cc3cf88ebf0 tempest-TestMinimumBasicScenario-1186437048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-01729c2f-1210-445b-859e-0cc3cf88ebf0 tempest-TestMinimumBasicScenario-1186437048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:18 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:47:18 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:19 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bd339c14-8715-4e4b-9c04-76cc6a751a2a tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.d2cf4770-e88b-4204-b026-8a860cf5cb82" returned: 0 in 0.337s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:19 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-bd339c14-8715-4e4b-9c04-76cc6a751a2a tempest-VolumesSnapshotListTestJSON-101223265 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.d2cf4770-e88b-4204-b026-8a860cf5cb82 is being set with open permissions: ugo+rw Jul 17 19:47:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bd339c14-8715-4e4b-9c04-76cc6a751a2a tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.d2cf4770-e88b-4204-b026-8a860cf5cb82 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:19 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.d2cf4770-e88b-4204-b026-8a860cf5cb82 Jul 17 19:47:19 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:19 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-01729c2f-1210-445b-859e-0cc3cf88ebf0 tempest-TestMinimumBasicScenario-1186437048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.306s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:19 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-01729c2f-1210-445b-859e-0cc3cf88ebf0 tempest-TestMinimumBasicScenario-1186437048 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:47:19 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-01729c2f-1210-445b-859e-0cc3cf88ebf0 tempest-TestMinimumBasicScenario-1186437048 None] Deleted volume successfully. Jul 17 19:47:19 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-01729c2f-1210-445b-859e-0cc3cf88ebf0 tempest-TestMinimumBasicScenario-1186437048 None] Lock "cinder-c86b6b7f-4024-48c6-8584-04d1164ce50f-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:19 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bd339c14-8715-4e4b-9c04-76cc6a751a2a tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.d2cf4770-e88b-4204-b026-8a860cf5cb82" returned: 0 in 0.363s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-bd339c14-8715-4e4b-9c04-76cc6a751a2a tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.751s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:19 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:47:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] Flow 'volume_create_manager' (f68a03ab-6a51-4285-a8c6-ab4267362e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:47:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7352ca-754f-4616-9ea9-4e865d209294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7352ca-754f-4616-9ea9-4e865d209294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-38169811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ffc3c45-8b36-4cd0-9ea8-4f22aeabc2aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636ffb0121744020a03c7253347e00f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:47:19Z,use_quota=True,user_id='cc32ebc3d215468d87111ce07bdb978c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d36d37-5f1e-475a-8ea6-e2d95cf5f564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d36d37-5f1e-475a-8ea6-e2d95cf5f564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f507404-e618-47f7-b175-796d864d915d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f507404-e618-47f7-b175-796d864d915d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ffc3c45-8b36-4cd0-9ea8-4f22aeabc2aa', 'volume_name': 'volume-7ffc3c45-8b36-4cd0-9ea8-4f22aeabc2aa', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c957a4-f908-4f48-b548-a265c5b228e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c957a4-f908-4f48-b548-a265c5b228e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda8949a-5ca4-4a4b-a604-442fd25a8b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:19 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] Volume 7ffc3c45-8b36-4cd0-9ea8-4f22aeabc2aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ffc3c45-8b36-4cd0-9ea8-4f22aeabc2aa', 'volume_size': 1} Jul 17 19:47:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:19 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-38169811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ffc3c45-8b36-4cd0-9ea8-4f22aeabc2aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636ffb0121744020a03c7253347e00f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:47:19Z,use_quota=True,user_id='cc32ebc3d215468d87111ce07bdb978c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:47:19 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] Creating volume 7ffc3c45-8b36-4cd0-9ea8-4f22aeabc2aa {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:47:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:19 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:47:19 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:47:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:19 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:47:19 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:47:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7ffc3c45-8b36-4cd0-9ea8-4f22aeabc2aa 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:19 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-bd339c14-8715-4e4b-9c04-76cc6a751a2a tempest-VolumesSnapshotListTestJSON-101223265 None] Create snapshot completed successfully Jul 17 19:47:19 devstack sudo[99279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7ffc3c45-8b36-4cd0-9ea8-4f22aeabc2aa 1073741824 Jul 17 19:47:19 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:20 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7ffc3c45-8b36-4cd0-9ea8-4f22aeabc2aa 1073741824" returned: 0 in 0.594s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7ffc3c45-8b36-4cd0-9ea8-4f22aeabc2aa {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:20 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7ffc3c45-8b36-4cd0-9ea8-4f22aeabc2aa Jul 17 19:47:20 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:20 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7ffc3c45-8b36-4cd0-9ea8-4f22aeabc2aa" returned: 0 in 0.381s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:20 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:47:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:20 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda8949a-5ca4-4a4b-a604-442fd25a8b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ffc3c45-8b36-4cd0-9ea8-4f22aeabc2aa', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:20 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0319d60f-a675-428c-bf4a-b597b4184ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:20 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] Volume volume-7ffc3c45-8b36-4cd0-9ea8-4f22aeabc2aa (7ffc3c45-8b36-4cd0-9ea8-4f22aeabc2aa): created successfully Jul 17 19:47:20 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0319d60f-a675-428c-bf4a-b597b4184ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:20 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] Flow 'volume_create_manager' (f68a03ab-6a51-4285-a8c6-ab4267362e66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:47:20 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-1fef7508-c8e3-4b3a-8365-cd36b55b8f8d tempest-VolumesListAdminTestJSON-1678900907 None] Created volume successfully. Jul 17 19:47:21 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a60af0b2-03f2-4094-bcb2-009a2482e62d tempest-VolumesSnapshotListTestJSON-101223265 None] Acquiring lock "cinder-d2cf4770-e88b-4204-b026-8a860cf5cb82-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:21 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a60af0b2-03f2-4094-bcb2-009a2482e62d tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "cinder-d2cf4770-e88b-4204-b026-8a860cf5cb82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:21 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a60af0b2-03f2-4094-bcb2-009a2482e62d tempest-VolumesSnapshotListTestJSON-101223265 None] Acquiring lock "cinder-quobyte-d9a703a1-a995-4510-a160-20d9a027d62d" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:21 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a60af0b2-03f2-4094-bcb2-009a2482e62d tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "cinder-quobyte-d9a703a1-a995-4510-a160-20d9a027d62d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:21 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a60af0b2-03f2-4094-bcb2-009a2482e62d tempest-VolumesSnapshotListTestJSON-101223265 None] Acquiring lock "cinder-quobyte-d2cf4770-e88b-4204-b026-8a860cf5cb82" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:21 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a60af0b2-03f2-4094-bcb2-009a2482e62d tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "cinder-quobyte-d2cf4770-e88b-4204-b026-8a860cf5cb82" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-a60af0b2-03f2-4094-bcb2-009a2482e62d tempest-VolumesSnapshotListTestJSON-101223265 None] Deleting offline snapshot d2cf4770-e88b-4204-b026-8a860cf5cb82 of volume d9a703a1-a995-4510-a160-20d9a027d62d {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:47:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-a60af0b2-03f2-4094-bcb2-009a2482e62d tempest-VolumesSnapshotListTestJSON-101223265 None] snapshot_file for this snap is: volume-d9a703a1-a995-4510-a160-20d9a027d62d.d2cf4770-e88b-4204-b026-8a860cf5cb82 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:47:21 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[225cbbbc-d0e1-4a31-99b5-889d73e8bd0b]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:47:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a60af0b2-03f2-4094-bcb2-009a2482e62d tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.d2cf4770-e88b-4204-b026-8a860cf5cb82 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:21 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.d2cf4770-e88b-4204-b026-8a860cf5cb82 Jul 17 19:47:21 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:21 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a60af0b2-03f2-4094-bcb2-009a2482e62d tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.d2cf4770-e88b-4204-b026-8a860cf5cb82" returned: 0 in 0.376s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-a60af0b2-03f2-4094-bcb2-009a2482e62d tempest-VolumesSnapshotListTestJSON-101223265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9a703a1-a995-4510-a160-20d9a027d62d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[9389d82d-6361-4fb6-9814-7da0016584ed]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a60af0b2-03f2-4094-bcb2-009a2482e62d tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] Flow 'volume_create_manager' (76899e1e-b2c1-4d69-a000-466a7b067722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c68824-8125-493b-aba3-80921bc7766a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c68824-8125-493b-aba3-80921bc7766a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-741243584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed4b8cc0-477c-4667-b1f3-8aab3a2d726b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636ffb0121744020a03c7253347e00f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:47:22Z,use_quota=True,user_id='cc32ebc3d215468d87111ce07bdb978c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78f72a5-9e68-4467-a23a-17d6dfba18a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78f72a5-9e68-4467-a23a-17d6dfba18a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (847fcdcc-4687-47a7-a0f6-7ae609a3a25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (847fcdcc-4687-47a7-a0f6-7ae609a3a25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed4b8cc0-477c-4667-b1f3-8aab3a2d726b', 'volume_name': 'volume-ed4b8cc0-477c-4667-b1f3-8aab3a2d726b', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0cccadc-9dad-49b0-8bf2-fa6981cabebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0cccadc-9dad-49b0-8bf2-fa6981cabebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:22 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b Jul 17 19:47:22 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b178699-da0a-4981-9de3-766920fef55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:22 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] Volume ed4b8cc0-477c-4667-b1f3-8aab3a2d726b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed4b8cc0-477c-4667-b1f3-8aab3a2d726b', 'volume_size': 1} Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-741243584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed4b8cc0-477c-4667-b1f3-8aab3a2d726b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636ffb0121744020a03c7253347e00f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:47:22Z,use_quota=True,user_id='cc32ebc3d215468d87111ce07bdb978c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] Creating volume ed4b8cc0-477c-4667-b1f3-8aab3a2d726b {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:47:22 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ed4b8cc0-477c-4667-b1f3-8aab3a2d726b 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:22 devstack sudo[99304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ed4b8cc0-477c-4667-b1f3-8aab3a2d726b 1073741824 Jul 17 19:47:22 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:22 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a60af0b2-03f2-4094-bcb2-009a2482e62d tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b" returned: 0 in 0.434s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-a60af0b2-03f2-4094-bcb2-009a2482e62d tempest-VolumesSnapshotListTestJSON-101223265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9a703a1-a995-4510-a160-20d9a027d62d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a60af0b2-03f2-4094-bcb2-009a2482e62d tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.d2cf4770-e88b-4204-b026-8a860cf5cb82 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:22 devstack sudo[99312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.d2cf4770-e88b-4204-b026-8a860cf5cb82 Jul 17 19:47:22 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:22 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ed4b8cc0-477c-4667-b1f3-8aab3a2d726b 1073741824" returned: 0 in 0.485s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ed4b8cc0-477c-4667-b1f3-8aab3a2d726b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:22 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ed4b8cc0-477c-4667-b1f3-8aab3a2d726b Jul 17 19:47:22 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:22 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a60af0b2-03f2-4094-bcb2-009a2482e62d tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.d2cf4770-e88b-4204-b026-8a860cf5cb82" returned: 0 in 0.488s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a60af0b2-03f2-4094-bcb2-009a2482e62d tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.d2cf4770-e88b-4204-b026-8a860cf5cb82 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:22 devstack sudo[99323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.d2cf4770-e88b-4204-b026-8a860cf5cb82 Jul 17 19:47:22 devstack sudo[99323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:23 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ed4b8cc0-477c-4667-b1f3-8aab3a2d726b" returned: 0 in 0.292s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:47:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b178699-da0a-4981-9de3-766920fef55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed4b8cc0-477c-4667-b1f3-8aab3a2d726b', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d9e9c22-7a22-4e5a-8869-09d5212fc3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:23 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] Volume volume-ed4b8cc0-477c-4667-b1f3-8aab3a2d726b (ed4b8cc0-477c-4667-b1f3-8aab3a2d726b): created successfully Jul 17 19:47:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d9e9c22-7a22-4e5a-8869-09d5212fc3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] Flow 'volume_create_manager' (76899e1e-b2c1-4d69-a000-466a7b067722) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:47:23 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-f702c1f4-633f-4ba9-985d-dd3f8e35386c tempest-VolumesListAdminTestJSON-1678900907 None] Created volume successfully. Jul 17 19:47:23 devstack sudo[99323]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a60af0b2-03f2-4094-bcb2-009a2482e62d tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.d2cf4770-e88b-4204-b026-8a860cf5cb82" returned: 0 in 0.279s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a60af0b2-03f2-4094-bcb2-009a2482e62d tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "cinder-quobyte-d2cf4770-e88b-4204-b026-8a860cf5cb82" released by "_delete_snapshot" :: held 1.691s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a60af0b2-03f2-4094-bcb2-009a2482e62d tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "cinder-quobyte-d9a703a1-a995-4510-a160-20d9a027d62d" released by "delete_snapshot" :: held 1.717s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:23 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-a60af0b2-03f2-4094-bcb2-009a2482e62d tempest-VolumesSnapshotListTestJSON-101223265 None] Created reservations ['8abde329-3b04-4095-a1f0-098889cfb8c2', '1f721b27-c02b-4496-930d-059fb9087232', '3bd15b68-7a1c-4783-b8da-315f8f8e661f', '91c310ad-6684-416c-9300-c6cf5479122f'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:47:23 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-a60af0b2-03f2-4094-bcb2-009a2482e62d tempest-VolumesSnapshotListTestJSON-101223265 None] Delete snapshot completed successfully. Jul 17 19:47:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a60af0b2-03f2-4094-bcb2-009a2482e62d tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "cinder-d2cf4770-e88b-4204-b026-8a860cf5cb82-delete_snapshot" released by "delete_snapshot" :: held 1.907s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0d3aaaf4-dc0d-49c8-92cc-47ffd821e9d2 tempest-VolumesSnapshotListTestJSON-101223265 None] Acquiring lock "cinder-e358eee7-f101-43e3-a531-28793ac3430b-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0d3aaaf4-dc0d-49c8-92cc-47ffd821e9d2 tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "cinder-e358eee7-f101-43e3-a531-28793ac3430b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0d3aaaf4-dc0d-49c8-92cc-47ffd821e9d2 tempest-VolumesSnapshotListTestJSON-101223265 None] Acquiring lock "cinder-quobyte-d9a703a1-a995-4510-a160-20d9a027d62d" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0d3aaaf4-dc0d-49c8-92cc-47ffd821e9d2 tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "cinder-quobyte-d9a703a1-a995-4510-a160-20d9a027d62d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0d3aaaf4-dc0d-49c8-92cc-47ffd821e9d2 tempest-VolumesSnapshotListTestJSON-101223265 None] Acquiring lock "cinder-quobyte-e358eee7-f101-43e3-a531-28793ac3430b" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0d3aaaf4-dc0d-49c8-92cc-47ffd821e9d2 tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "cinder-quobyte-e358eee7-f101-43e3-a531-28793ac3430b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-0d3aaaf4-dc0d-49c8-92cc-47ffd821e9d2 tempest-VolumesSnapshotListTestJSON-101223265 None] Deleting offline snapshot e358eee7-f101-43e3-a531-28793ac3430b of volume d9a703a1-a995-4510-a160-20d9a027d62d {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:47:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-0d3aaaf4-dc0d-49c8-92cc-47ffd821e9d2 tempest-VolumesSnapshotListTestJSON-101223265 None] snapshot_file for this snap is: volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:47:23 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda09de4-3af0-4eec-85cf-602d845278a6]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:47:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0d3aaaf4-dc0d-49c8-92cc-47ffd821e9d2 tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:23 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b Jul 17 19:47:23 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:24 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0d3aaaf4-dc0d-49c8-92cc-47ffd821e9d2 tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b" returned: 0 in 0.387s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-0d3aaaf4-dc0d-49c8-92cc-47ffd821e9d2 tempest-VolumesSnapshotListTestJSON-101223265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9a703a1-a995-4510-a160-20d9a027d62d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:47:24 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bbd35e-8f88-47d7-b0e3-5052722929ea]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:47:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0d3aaaf4-dc0d-49c8-92cc-47ffd821e9d2 tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:24 devstack sudo[99332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400 Jul 17 19:47:24 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:24 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0d3aaaf4-dc0d-49c8-92cc-47ffd821e9d2 tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400" returned: 0 in 0.394s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-0d3aaaf4-dc0d-49c8-92cc-47ffd821e9d2 tempest-VolumesSnapshotListTestJSON-101223265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9a703a1-a995-4510-a160-20d9a027d62d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:47:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0d3aaaf4-dc0d-49c8-92cc-47ffd821e9d2 tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:24 devstack sudo[99337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b Jul 17 19:47:24 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:24 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:47:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] Flow 'volume_create_manager' (4438789b-ab58-417e-aea4-be8e3bd6dae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:47:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3039638b-5d52-40be-9809-ee50eaffae95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3039638b-5d52-40be-9809-ee50eaffae95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7485583c-0c6f-4bf2-b43b-cd011429d74b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4983be9869744e5f9054a543e9b09388',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:47:25Z,use_quota=True,user_id='e4877d755a3b4c76b075cb4710070459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bf64f6a-04e7-47a8-b07c-3bc4bd6a0d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bf64f6a-04e7-47a8-b07c-3bc4bd6a0d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5e09074-78de-4ce9-a72b-372ec4fe3744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5e09074-78de-4ce9-a72b-372ec4fe3744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7485583c-0c6f-4bf2-b43b-cd011429d74b', 'volume_name': 'volume-7485583c-0c6f-4bf2-b43b-cd011429d74b', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d3a31b-2438-46ee-ab36-c6c56449f261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d3a31b-2438-46ee-ab36-c6c56449f261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55829c22-5182-4333-bbc6-b42d66036f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:25 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] Volume 7485583c-0c6f-4bf2-b43b-cd011429d74b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7485583c-0c6f-4bf2-b43b-cd011429d74b', 'volume_size': 1} Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7485583c-0c6f-4bf2-b43b-cd011429d74b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4983be9869744e5f9054a543e9b09388',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:47:25Z,use_quota=True,user_id='e4877d755a3b4c76b075cb4710070459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] Creating volume 7485583c-0c6f-4bf2-b43b-cd011429d74b {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:47:25 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7485583c-0c6f-4bf2-b43b-cd011429d74b 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:25 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7485583c-0c6f-4bf2-b43b-cd011429d74b 1073741824 Jul 17 19:47:25 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:25 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0d3aaaf4-dc0d-49c8-92cc-47ffd821e9d2 tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b" returned: 0 in 0.469s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0d3aaaf4-dc0d-49c8-92cc-47ffd821e9d2 tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:25 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b Jul 17 19:47:25 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:25 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0d3aaaf4-dc0d-49c8-92cc-47ffd821e9d2 tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.e358eee7-f101-43e3-a531-28793ac3430b" returned: 0 in 0.321s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0d3aaaf4-dc0d-49c8-92cc-47ffd821e9d2 tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "cinder-quobyte-e358eee7-f101-43e3-a531-28793ac3430b" released by "_delete_snapshot" :: held 1.731s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0d3aaaf4-dc0d-49c8-92cc-47ffd821e9d2 tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "cinder-quobyte-d9a703a1-a995-4510-a160-20d9a027d62d" released by "delete_snapshot" :: held 1.758s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-0d3aaaf4-dc0d-49c8-92cc-47ffd821e9d2 tempest-VolumesSnapshotListTestJSON-101223265 None] Created reservations ['ef16fd34-3114-4113-9bf9-7bbf84131f1b', '441019ef-def7-4857-a725-fe164299edcf', '2e518326-bb2a-4fcc-9636-6cee93fbe235', 'a113afbc-9671-4560-9f07-75fe10d1aa3e'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:47:25 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7485583c-0c6f-4bf2-b43b-cd011429d74b 1073741824" returned: 0 in 0.578s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:25 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-0d3aaaf4-dc0d-49c8-92cc-47ffd821e9d2 tempest-VolumesSnapshotListTestJSON-101223265 None] Delete snapshot completed successfully. Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0d3aaaf4-dc0d-49c8-92cc-47ffd821e9d2 tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "cinder-e358eee7-f101-43e3-a531-28793ac3430b-delete_snapshot" released by "delete_snapshot" :: held 1.928s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7485583c-0c6f-4bf2-b43b-cd011429d74b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:25 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7485583c-0c6f-4bf2-b43b-cd011429d74b Jul 17 19:47:25 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-26ae6283-8633-48b5-845a-1fb2b91334e8 tempest-VolumesSnapshotListTestJSON-101223265 None] Acquiring lock "cinder-23535702-c82e-422d-9699-18807c29e400-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:25 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7485583c-0c6f-4bf2-b43b-cd011429d74b" returned: 0 in 0.277s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-26ae6283-8633-48b5-845a-1fb2b91334e8 tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "cinder-23535702-c82e-422d-9699-18807c29e400-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-26ae6283-8633-48b5-845a-1fb2b91334e8 tempest-VolumesSnapshotListTestJSON-101223265 None] Acquiring lock "cinder-quobyte-d9a703a1-a995-4510-a160-20d9a027d62d" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55829c22-5182-4333-bbc6-b42d66036f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7485583c-0c6f-4bf2-b43b-cd011429d74b', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8193d498-ce92-4150-aedf-01a10fd8a78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-26ae6283-8633-48b5-845a-1fb2b91334e8 tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "cinder-quobyte-d9a703a1-a995-4510-a160-20d9a027d62d" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-26ae6283-8633-48b5-845a-1fb2b91334e8 tempest-VolumesSnapshotListTestJSON-101223265 None] Acquiring lock "cinder-quobyte-23535702-c82e-422d-9699-18807c29e400" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:25 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] Volume volume-7485583c-0c6f-4bf2-b43b-cd011429d74b (7485583c-0c6f-4bf2-b43b-cd011429d74b): created successfully Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8193d498-ce92-4150-aedf-01a10fd8a78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] Flow 'volume_create_manager' (4438789b-ab58-417e-aea4-be8e3bd6dae3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-26ae6283-8633-48b5-845a-1fb2b91334e8 tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "cinder-quobyte-23535702-c82e-422d-9699-18807c29e400" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-26ae6283-8633-48b5-845a-1fb2b91334e8 tempest-VolumesSnapshotListTestJSON-101223265 None] Deleting offline snapshot 23535702-c82e-422d-9699-18807c29e400 of volume d9a703a1-a995-4510-a160-20d9a027d62d {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:47:26 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-26ae6283-8633-48b5-845a-1fb2b91334e8 tempest-VolumesSnapshotListTestJSON-101223265 None] snapshot_file for this snap is: volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:47:26 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-057535df-136c-4fcc-9000-6aa6f13a5b8c tempest-VolumesListAdminTestJSON-2117735524 None] Created volume successfully. Jul 17 19:47:26 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[176eeaa6-5bb4-43f6-954b-c8f899e3b77b]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:47:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-26ae6283-8633-48b5-845a-1fb2b91334e8 tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:26 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400 Jul 17 19:47:26 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:26 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-26ae6283-8633-48b5-845a-1fb2b91334e8 tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400" returned: 0 in 0.397s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:26 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-26ae6283-8633-48b5-845a-1fb2b91334e8 tempest-VolumesSnapshotListTestJSON-101223265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9a703a1-a995-4510-a160-20d9a027d62d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:47:26 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b673ac2-8be4-49ff-b882-04f9feec6bb7]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:47:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-26ae6283-8633-48b5-845a-1fb2b91334e8 tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:26 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d Jul 17 19:47:26 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:26 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-26ae6283-8633-48b5-845a-1fb2b91334e8 tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d" returned: 0 in 0.371s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-26ae6283-8633-48b5-845a-1fb2b91334e8 tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:26 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400 Jul 17 19:47:26 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2bd6bc7f-4de3-4f22-a503-992621ed7086 tempest-VolumesListAdminTestJSON-2117735524 None] Acquiring lock "cinder-7485583c-0c6f-4bf2-b43b-cd011429d74b-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2bd6bc7f-4de3-4f22-a503-992621ed7086 tempest-VolumesListAdminTestJSON-2117735524 None] Lock "cinder-7485583c-0c6f-4bf2-b43b-cd011429d74b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2bd6bc7f-4de3-4f22-a503-992621ed7086 tempest-VolumesListAdminTestJSON-2117735524 None] Acquiring lock "cinder-quobyte-7485583c-0c6f-4bf2-b43b-cd011429d74b" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2bd6bc7f-4de3-4f22-a503-992621ed7086 tempest-VolumesListAdminTestJSON-2117735524 None] Lock "cinder-quobyte-7485583c-0c6f-4bf2-b43b-cd011429d74b" acquired by "delete_volume" :: waited 0.019s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:27 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[778d19a1-971c-4caa-9a0a-f98b8a4cf55c]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:47:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2bd6bc7f-4de3-4f22-a503-992621ed7086 tempest-VolumesListAdminTestJSON-2117735524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7485583c-0c6f-4bf2-b43b-cd011429d74b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:27 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-26ae6283-8633-48b5-845a-1fb2b91334e8 tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400" returned: 0 in 0.420s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-26ae6283-8633-48b5-845a-1fb2b91334e8 tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-30ac6b4b-3eaf-4c7d-a431-79b0934b56d5 tempest-VolumesListAdminTestJSON-1678900907 None] Acquiring lock "cinder-ed4b8cc0-477c-4667-b1f3-8aab3a2d726b-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:27 devstack sudo[99372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400 Jul 17 19:47:27 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-30ac6b4b-3eaf-4c7d-a431-79b0934b56d5 tempest-VolumesListAdminTestJSON-1678900907 None] Lock "cinder-ed4b8cc0-477c-4667-b1f3-8aab3a2d726b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:27 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7485583c-0c6f-4bf2-b43b-cd011429d74b Jul 17 19:47:27 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-30ac6b4b-3eaf-4c7d-a431-79b0934b56d5 tempest-VolumesListAdminTestJSON-1678900907 None] Acquiring lock "cinder-quobyte-ed4b8cc0-477c-4667-b1f3-8aab3a2d726b" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-30ac6b4b-3eaf-4c7d-a431-79b0934b56d5 tempest-VolumesListAdminTestJSON-1678900907 None] Lock "cinder-quobyte-ed4b8cc0-477c-4667-b1f3-8aab3a2d726b" acquired by "delete_volume" :: waited 0.026s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:27 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ac5287-3a46-4567-9601-0ea66515794c]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:47:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-30ac6b4b-3eaf-4c7d-a431-79b0934b56d5 tempest-VolumesListAdminTestJSON-1678900907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ed4b8cc0-477c-4667-b1f3-8aab3a2d726b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:27 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ed4b8cc0-477c-4667-b1f3-8aab3a2d726b Jul 17 19:47:27 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:27 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-26ae6283-8633-48b5-845a-1fb2b91334e8 tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d.23535702-c82e-422d-9699-18807c29e400" returned: 0 in 0.340s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-26ae6283-8633-48b5-845a-1fb2b91334e8 tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "cinder-quobyte-23535702-c82e-422d-9699-18807c29e400" released by "_delete_snapshot" :: held 1.654s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-26ae6283-8633-48b5-845a-1fb2b91334e8 tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "cinder-quobyte-d9a703a1-a995-4510-a160-20d9a027d62d" released by "delete_snapshot" :: held 1.697s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:27 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2bd6bc7f-4de3-4f22-a503-992621ed7086 tempest-VolumesListAdminTestJSON-2117735524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7485583c-0c6f-4bf2-b43b-cd011429d74b" returned: 0 in 0.510s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2bd6bc7f-4de3-4f22-a503-992621ed7086 tempest-VolumesListAdminTestJSON-2117735524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7485583c-0c6f-4bf2-b43b-cd011429d74b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:27 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7485583c-0c6f-4bf2-b43b-cd011429d74b Jul 17 19:47:27 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:27 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-26ae6283-8633-48b5-845a-1fb2b91334e8 tempest-VolumesSnapshotListTestJSON-101223265 None] Created reservations ['951b1a0b-bbed-4add-b57c-16b2db6d8071', '189b83d4-98f1-4150-8341-7eebf386bc74', 'a5471246-782f-43b9-b6ae-ccab6c50ced7', '62321d34-fb33-4a43-8f1f-bc8e5767bfdd'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:47:27 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-30ac6b4b-3eaf-4c7d-a431-79b0934b56d5 tempest-VolumesListAdminTestJSON-1678900907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ed4b8cc0-477c-4667-b1f3-8aab3a2d726b" returned: 0 in 0.486s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-30ac6b4b-3eaf-4c7d-a431-79b0934b56d5 tempest-VolumesListAdminTestJSON-1678900907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ed4b8cc0-477c-4667-b1f3-8aab3a2d726b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:27 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-26ae6283-8633-48b5-845a-1fb2b91334e8 tempest-VolumesSnapshotListTestJSON-101223265 None] Delete snapshot completed successfully. Jul 17 19:47:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-26ae6283-8633-48b5-845a-1fb2b91334e8 tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "cinder-23535702-c82e-422d-9699-18807c29e400-delete_snapshot" released by "delete_snapshot" :: held 2.029s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:27 devstack sudo[99387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ed4b8cc0-477c-4667-b1f3-8aab3a2d726b Jul 17 19:47:27 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:28 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2bd6bc7f-4de3-4f22-a503-992621ed7086 tempest-VolumesListAdminTestJSON-2117735524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7485583c-0c6f-4bf2-b43b-cd011429d74b" returned: 0 in 0.324s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2bd6bc7f-4de3-4f22-a503-992621ed7086 tempest-VolumesListAdminTestJSON-2117735524 None] Lock "cinder-quobyte-7485583c-0c6f-4bf2-b43b-cd011429d74b" released by "delete_volume" :: held 0.880s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-2bd6bc7f-4de3-4f22-a503-992621ed7086 tempest-VolumesListAdminTestJSON-2117735524 None] Created reservations ['70574d77-a893-4711-9b28-e4a2c4a0d400', '88afaf18-15da-43fa-82ae-16e8f89d13d2', '1e273d57-483d-4694-a15d-cdf1755346a6', '3c6ee5ad-e214-46fa-95a4-fb2c1016ed6b'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0792ffd5-8d47-4b18-9933-30cf6a47f33f tempest-VolumesSnapshotListTestJSON-101223265 None] Acquiring lock "cinder-d9a703a1-a995-4510-a160-20d9a027d62d-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:28 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-30ac6b4b-3eaf-4c7d-a431-79b0934b56d5 tempest-VolumesListAdminTestJSON-1678900907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ed4b8cc0-477c-4667-b1f3-8aab3a2d726b" returned: 0 in 0.324s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0792ffd5-8d47-4b18-9933-30cf6a47f33f tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "cinder-d9a703a1-a995-4510-a160-20d9a027d62d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-2bd6bc7f-4de3-4f22-a503-992621ed7086 tempest-VolumesListAdminTestJSON-2117735524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-2bd6bc7f-4de3-4f22-a503-992621ed7086 tempest-VolumesListAdminTestJSON-2117735524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-2bd6bc7f-4de3-4f22-a503-992621ed7086 tempest-VolumesListAdminTestJSON-2117735524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-2bd6bc7f-4de3-4f22-a503-992621ed7086 tempest-VolumesListAdminTestJSON-2117735524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-2bd6bc7f-4de3-4f22-a503-992621ed7086 tempest-VolumesListAdminTestJSON-2117735524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2bd6bc7f-4de3-4f22-a503-992621ed7086 tempest-VolumesListAdminTestJSON-2117735524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-30ac6b4b-3eaf-4c7d-a431-79b0934b56d5 tempest-VolumesListAdminTestJSON-1678900907 None] Lock "cinder-quobyte-ed4b8cc0-477c-4667-b1f3-8aab3a2d726b" released by "delete_volume" :: held 0.889s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:28 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:47:28 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0792ffd5-8d47-4b18-9933-30cf6a47f33f tempest-VolumesSnapshotListTestJSON-101223265 None] Acquiring lock "cinder-quobyte-d9a703a1-a995-4510-a160-20d9a027d62d" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0792ffd5-8d47-4b18-9933-30cf6a47f33f tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "cinder-quobyte-d9a703a1-a995-4510-a160-20d9a027d62d" acquired by "delete_volume" :: waited 0.021s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a092d1f-137a-483a-acb7-7b700d972040]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0792ffd5-8d47-4b18-9933-30cf6a47f33f tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-30ac6b4b-3eaf-4c7d-a431-79b0934b56d5 tempest-VolumesListAdminTestJSON-1678900907 None] Created reservations ['83488aec-20c4-47a4-9edd-24496d42bff9', '7c933c4b-c212-4765-8f78-51dfc3b99eb8', '7fb47783-9aed-4e19-91e2-f270127a3c67', 'd0da6964-04a3-4b56-b40c-44005318bbd1'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-30ac6b4b-3eaf-4c7d-a431-79b0934b56d5 tempest-VolumesListAdminTestJSON-1678900907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-30ac6b4b-3eaf-4c7d-a431-79b0934b56d5 tempest-VolumesListAdminTestJSON-1678900907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-30ac6b4b-3eaf-4c7d-a431-79b0934b56d5 tempest-VolumesListAdminTestJSON-1678900907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-30ac6b4b-3eaf-4c7d-a431-79b0934b56d5 tempest-VolumesListAdminTestJSON-1678900907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-30ac6b4b-3eaf-4c7d-a431-79b0934b56d5 tempest-VolumesListAdminTestJSON-1678900907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-30ac6b4b-3eaf-4c7d-a431-79b0934b56d5 tempest-VolumesListAdminTestJSON-1678900907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:28 devstack sudo[99395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:47:28 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:28 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d Jul 17 19:47:28 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:28 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2bd6bc7f-4de3-4f22-a503-992621ed7086 tempest-VolumesListAdminTestJSON-2117735524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.326s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-2bd6bc7f-4de3-4f22-a503-992621ed7086 tempest-VolumesListAdminTestJSON-2117735524 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:47:28 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-2bd6bc7f-4de3-4f22-a503-992621ed7086 tempest-VolumesListAdminTestJSON-2117735524 None] Deleted volume successfully. Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2bd6bc7f-4de3-4f22-a503-992621ed7086 tempest-VolumesListAdminTestJSON-2117735524 None] Lock "cinder-7485583c-0c6f-4bf2-b43b-cd011429d74b-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:28 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-30ac6b4b-3eaf-4c7d-a431-79b0934b56d5 tempest-VolumesListAdminTestJSON-1678900907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.264s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-30ac6b4b-3eaf-4c7d-a431-79b0934b56d5 tempest-VolumesListAdminTestJSON-1678900907 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:47:28 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-30ac6b4b-3eaf-4c7d-a431-79b0934b56d5 tempest-VolumesListAdminTestJSON-1678900907 None] Deleted volume successfully. Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-30ac6b4b-3eaf-4c7d-a431-79b0934b56d5 tempest-VolumesListAdminTestJSON-1678900907 None] Lock "cinder-ed4b8cc0-477c-4667-b1f3-8aab3a2d726b-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:28 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0792ffd5-8d47-4b18-9933-30cf6a47f33f tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d" returned: 0 in 0.480s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0792ffd5-8d47-4b18-9933-30cf6a47f33f tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:28 devstack sudo[99402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d Jul 17 19:47:28 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:29 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0792ffd5-8d47-4b18-9933-30cf6a47f33f tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d9a703a1-a995-4510-a160-20d9a027d62d" returned: 0 in 0.265s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0792ffd5-8d47-4b18-9933-30cf6a47f33f tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "cinder-quobyte-d9a703a1-a995-4510-a160-20d9a027d62d" released by "delete_volume" :: held 0.838s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:29 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-0792ffd5-8d47-4b18-9933-30cf6a47f33f tempest-VolumesSnapshotListTestJSON-101223265 None] Created reservations ['f02e28a3-eefa-4889-af88-a056012550c2', '1b77f92e-a959-4dd8-9a6b-ce573d74d4b6', '6d7fe56e-d868-474d-91de-414980636808', '0011098b-46ef-4fc1-911f-cf4e0178e0b2'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:47:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0792ffd5-8d47-4b18-9933-30cf6a47f33f tempest-VolumesSnapshotListTestJSON-101223265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0792ffd5-8d47-4b18-9933-30cf6a47f33f tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:29 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0792ffd5-8d47-4b18-9933-30cf6a47f33f tempest-VolumesSnapshotListTestJSON-101223265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:47:29 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0792ffd5-8d47-4b18-9933-30cf6a47f33f tempest-VolumesSnapshotListTestJSON-101223265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:47:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0792ffd5-8d47-4b18-9933-30cf6a47f33f tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0792ffd5-8d47-4b18-9933-30cf6a47f33f tempest-VolumesSnapshotListTestJSON-101223265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:29 devstack sudo[99405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:47:29 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1a5777c7-9511-485d-b89b-df1fe67c19c8 tempest-VolumesListAdminTestJSON-1678900907 None] Acquiring lock "cinder-7ffc3c45-8b36-4cd0-9ea8-4f22aeabc2aa-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1a5777c7-9511-485d-b89b-df1fe67c19c8 tempest-VolumesListAdminTestJSON-1678900907 None] Lock "cinder-7ffc3c45-8b36-4cd0-9ea8-4f22aeabc2aa-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1a5777c7-9511-485d-b89b-df1fe67c19c8 tempest-VolumesListAdminTestJSON-1678900907 None] Acquiring lock "cinder-quobyte-7ffc3c45-8b36-4cd0-9ea8-4f22aeabc2aa" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1a5777c7-9511-485d-b89b-df1fe67c19c8 tempest-VolumesListAdminTestJSON-1678900907 None] Lock "cinder-quobyte-7ffc3c45-8b36-4cd0-9ea8-4f22aeabc2aa" acquired by "delete_volume" :: waited 0.031s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:29 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0792ffd5-8d47-4b18-9933-30cf6a47f33f tempest-VolumesSnapshotListTestJSON-101223265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.492s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:29 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-0792ffd5-8d47-4b18-9933-30cf6a47f33f tempest-VolumesSnapshotListTestJSON-101223265 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:47:29 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-0792ffd5-8d47-4b18-9933-30cf6a47f33f tempest-VolumesSnapshotListTestJSON-101223265 None] Deleted volume successfully. Jul 17 19:47:29 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e4d0a7-b455-4895-97d2-f81440f2bf14]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:47:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1a5777c7-9511-485d-b89b-df1fe67c19c8 tempest-VolumesListAdminTestJSON-1678900907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7ffc3c45-8b36-4cd0-9ea8-4f22aeabc2aa {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0792ffd5-8d47-4b18-9933-30cf6a47f33f tempest-VolumesSnapshotListTestJSON-101223265 None] Lock "cinder-d9a703a1-a995-4510-a160-20d9a027d62d-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:30 devstack sudo[99409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7ffc3c45-8b36-4cd0-9ea8-4f22aeabc2aa Jul 17 19:47:30 devstack sudo[99409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:30 devstack sudo[99409]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1a5777c7-9511-485d-b89b-df1fe67c19c8 tempest-VolumesListAdminTestJSON-1678900907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7ffc3c45-8b36-4cd0-9ea8-4f22aeabc2aa" returned: 0 in 0.447s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1a5777c7-9511-485d-b89b-df1fe67c19c8 tempest-VolumesListAdminTestJSON-1678900907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7ffc3c45-8b36-4cd0-9ea8-4f22aeabc2aa {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:30 devstack sudo[99416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7ffc3c45-8b36-4cd0-9ea8-4f22aeabc2aa Jul 17 19:47:30 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:30 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1a5777c7-9511-485d-b89b-df1fe67c19c8 tempest-VolumesListAdminTestJSON-1678900907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7ffc3c45-8b36-4cd0-9ea8-4f22aeabc2aa" returned: 0 in 0.371s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:30 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1a5777c7-9511-485d-b89b-df1fe67c19c8 tempest-VolumesListAdminTestJSON-1678900907 None] Lock "cinder-quobyte-7ffc3c45-8b36-4cd0-9ea8-4f22aeabc2aa" released by "delete_volume" :: held 0.888s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:30 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-1a5777c7-9511-485d-b89b-df1fe67c19c8 tempest-VolumesListAdminTestJSON-1678900907 None] Created reservations ['61b75c32-2b26-4a53-8536-097f2287108c', 'ae0ae6ec-48aa-45eb-9f94-1e27d1e7de16', 'fab3ac90-783c-4659-99e4-ec8483dcd550', '71b4f3a9-64f7-48b6-85f0-8fab2724507e'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:47:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1a5777c7-9511-485d-b89b-df1fe67c19c8 tempest-VolumesListAdminTestJSON-1678900907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1a5777c7-9511-485d-b89b-df1fe67c19c8 tempest-VolumesListAdminTestJSON-1678900907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:30 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-1a5777c7-9511-485d-b89b-df1fe67c19c8 tempest-VolumesListAdminTestJSON-1678900907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:47:30 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-1a5777c7-9511-485d-b89b-df1fe67c19c8 tempest-VolumesListAdminTestJSON-1678900907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:47:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1a5777c7-9511-485d-b89b-df1fe67c19c8 tempest-VolumesListAdminTestJSON-1678900907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1a5777c7-9511-485d-b89b-df1fe67c19c8 tempest-VolumesListAdminTestJSON-1678900907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:30 devstack sudo[99419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:47:30 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:31 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-abffef76-216c-4fd9-9d43-ff5cf4a884fa tempest-VolumesListAdminTestJSON-1678900907 None] Acquiring lock "cinder-bd0b9707-9da9-4c1b-9b29-54e53dfa58a3-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:31 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-abffef76-216c-4fd9-9d43-ff5cf4a884fa tempest-VolumesListAdminTestJSON-1678900907 None] Lock "cinder-bd0b9707-9da9-4c1b-9b29-54e53dfa58a3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:31 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-abffef76-216c-4fd9-9d43-ff5cf4a884fa tempest-VolumesListAdminTestJSON-1678900907 None] Acquiring lock "cinder-quobyte-bd0b9707-9da9-4c1b-9b29-54e53dfa58a3" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:31 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-abffef76-216c-4fd9-9d43-ff5cf4a884fa tempest-VolumesListAdminTestJSON-1678900907 None] Lock "cinder-quobyte-bd0b9707-9da9-4c1b-9b29-54e53dfa58a3" acquired by "delete_volume" :: waited 0.020s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:31 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b7ebba-a581-44cd-9ca9-bceb2a13ae0c]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:47:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-abffef76-216c-4fd9-9d43-ff5cf4a884fa tempest-VolumesListAdminTestJSON-1678900907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bd0b9707-9da9-4c1b-9b29-54e53dfa58a3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:31 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1a5777c7-9511-485d-b89b-df1fe67c19c8 tempest-VolumesListAdminTestJSON-1678900907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.388s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:31 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-1a5777c7-9511-485d-b89b-df1fe67c19c8 tempest-VolumesListAdminTestJSON-1678900907 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:47:31 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-1a5777c7-9511-485d-b89b-df1fe67c19c8 tempest-VolumesListAdminTestJSON-1678900907 None] Deleted volume successfully. Jul 17 19:47:31 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1a5777c7-9511-485d-b89b-df1fe67c19c8 tempest-VolumesListAdminTestJSON-1678900907 None] Lock "cinder-7ffc3c45-8b36-4cd0-9ea8-4f22aeabc2aa-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:31 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bd0b9707-9da9-4c1b-9b29-54e53dfa58a3 Jul 17 19:47:31 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:31 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-abffef76-216c-4fd9-9d43-ff5cf4a884fa tempest-VolumesListAdminTestJSON-1678900907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bd0b9707-9da9-4c1b-9b29-54e53dfa58a3" returned: 0 in 0.410s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-abffef76-216c-4fd9-9d43-ff5cf4a884fa tempest-VolumesListAdminTestJSON-1678900907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bd0b9707-9da9-4c1b-9b29-54e53dfa58a3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:31 devstack sudo[99427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bd0b9707-9da9-4c1b-9b29-54e53dfa58a3 Jul 17 19:47:31 devstack sudo[99427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:31 devstack sudo[99427]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-abffef76-216c-4fd9-9d43-ff5cf4a884fa tempest-VolumesListAdminTestJSON-1678900907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bd0b9707-9da9-4c1b-9b29-54e53dfa58a3" returned: 0 in 0.304s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:31 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-abffef76-216c-4fd9-9d43-ff5cf4a884fa tempest-VolumesListAdminTestJSON-1678900907 None] Lock "cinder-quobyte-bd0b9707-9da9-4c1b-9b29-54e53dfa58a3" released by "delete_volume" :: held 0.776s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:31 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-abffef76-216c-4fd9-9d43-ff5cf4a884fa tempest-VolumesListAdminTestJSON-1678900907 None] Created reservations ['35d1e003-a4a5-4f50-bc39-eb56bf144d30', 'c9b3ad50-0f5c-4a83-aaff-819143d1a549', '8ab80dd1-715e-45a8-bb77-5fc51d19a126', 'fb915af0-d33a-47e9-bced-0fe560793d3e'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:47:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-abffef76-216c-4fd9-9d43-ff5cf4a884fa tempest-VolumesListAdminTestJSON-1678900907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-abffef76-216c-4fd9-9d43-ff5cf4a884fa tempest-VolumesListAdminTestJSON-1678900907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:32 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-abffef76-216c-4fd9-9d43-ff5cf4a884fa tempest-VolumesListAdminTestJSON-1678900907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:47:32 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-abffef76-216c-4fd9-9d43-ff5cf4a884fa tempest-VolumesListAdminTestJSON-1678900907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:47:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-abffef76-216c-4fd9-9d43-ff5cf4a884fa tempest-VolumesListAdminTestJSON-1678900907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-abffef76-216c-4fd9-9d43-ff5cf4a884fa tempest-VolumesListAdminTestJSON-1678900907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:32 devstack sudo[99430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:47:32 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:32 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-abffef76-216c-4fd9-9d43-ff5cf4a884fa tempest-VolumesListAdminTestJSON-1678900907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.290s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:32 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-abffef76-216c-4fd9-9d43-ff5cf4a884fa tempest-VolumesListAdminTestJSON-1678900907 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:47:32 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-abffef76-216c-4fd9-9d43-ff5cf4a884fa tempest-VolumesListAdminTestJSON-1678900907 None] Deleted volume successfully. Jul 17 19:47:32 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-abffef76-216c-4fd9-9d43-ff5cf4a884fa tempest-VolumesListAdminTestJSON-1678900907 None] Lock "cinder-bd0b9707-9da9-4c1b-9b29-54e53dfa58a3-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:33 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:47:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Flow 'volume_create_manager' (7b2e050c-79e4-451b-9131-a61a3ad00308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:47:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca8f6c3c-22e8-4388-961d-3b4aa79a1932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca8f6c3c-22e8-4388-961d-3b4aa79a1932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1898659575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cecb600-150e-4a4e-a7dd-2210485f8ea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c18bdbf3f1144304b1051c0710b1b377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:47:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:47:34Z,use_quota=True,user_id='edbff5de2d2341df83826e73953fd452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e802c092-5c0a-4c3a-add4-146721067c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e802c092-5c0a-4c3a-add4-146721067c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb74d43a-9637-46d4-ba62-aa26d77a0121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb74d43a-9637-46d4-ba62-aa26d77a0121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cecb600-150e-4a4e-a7dd-2210485f8ea2', 'volume_name': 'volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2', 'volume_size': 2}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e0233e5-d63a-4779-9342-719ef1a05c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e0233e5-d63a-4779-9342-719ef1a05c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff9ce313-2bbd-4c12-acd2-29a2c6d2941e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:33 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Volume 5cecb600-150e-4a4e-a7dd-2210485f8ea2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2', 'volume_size': 2} Jul 17 19:47:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1898659575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cecb600-150e-4a4e-a7dd-2210485f8ea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c18bdbf3f1144304b1051c0710b1b377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:47:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:47:34Z,use_quota=True,user_id='edbff5de2d2341df83826e73953fd452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:47:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Creating volume 5cecb600-150e-4a4e-a7dd-2210485f8ea2 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:47:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:47:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:47:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:47:33 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:47:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2 2147483648 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:33 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2 2147483648 Jul 17 19:47:33 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:34 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2 2147483648" returned: 0 in 0.610s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:34 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2 Jul 17 19:47:34 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:34 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2" returned: 0 in 0.353s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:34 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:47:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff9ce313-2bbd-4c12-acd2-29a2c6d2941e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2', 'volume_size': 2}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b6ae4b6-7e5c-4f94-90a7-36e12e6ca238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:34 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Volume volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2 (5cecb600-150e-4a4e-a7dd-2210485f8ea2): created successfully Jul 17 19:47:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b6ae4b6-7e5c-4f94-90a7-36e12e6ca238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Flow 'volume_create_manager' (7b2e050c-79e4-451b-9131-a61a3ad00308) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:47:34 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-822b652c-0352-4ba6-9510-ff564f62cb31 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Created volume successfully. Jul 17 19:47:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c831746f-06a8-4904-a0c0-2bd56bf712d7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c831746f-06a8-4904-a0c0-2bd56bf712d7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:35 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-c831746f-06a8-4904-a0c0-2bd56bf712d7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Creating offline snapshot 55375ccf-c733-4362-9e98-4864f3458144 of volume 5cecb600-150e-4a4e-a7dd-2210485f8ea2 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:47:35 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[00586d4c-0205-4fb8-b9cd-bd121c5a38a8]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:47:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c831746f-06a8-4904-a0c0-2bd56bf712d7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:36 devstack sudo[99443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2 Jul 17 19:47:36 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:36 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c831746f-06a8-4904-a0c0-2bd56bf712d7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2" returned: 0 in 0.397s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c831746f-06a8-4904-a0c0-2bd56bf712d7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2.55375ccf-c733-4362-9e98-4864f3458144 2G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:36 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2.55375ccf-c733-4362-9e98-4864f3458144 2G Jul 17 19:47:36 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:36 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c831746f-06a8-4904-a0c0-2bd56bf712d7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2.55375ccf-c733-4362-9e98-4864f3458144 2G" returned: 0 in 0.526s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c831746f-06a8-4904-a0c0-2bd56bf712d7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2.55375ccf-c733-4362-9e98-4864f3458144 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:36 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2.55375ccf-c733-4362-9e98-4864f3458144 Jul 17 19:47:36 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:37 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c831746f-06a8-4904-a0c0-2bd56bf712d7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2.55375ccf-c733-4362-9e98-4864f3458144" returned: 0 in 0.305s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:37 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-c831746f-06a8-4904-a0c0-2bd56bf712d7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2.55375ccf-c733-4362-9e98-4864f3458144 is being set with open permissions: ugo+rw Jul 17 19:47:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c831746f-06a8-4904-a0c0-2bd56bf712d7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2.55375ccf-c733-4362-9e98-4864f3458144 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:37 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2.55375ccf-c733-4362-9e98-4864f3458144 Jul 17 19:47:37 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:37 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c831746f-06a8-4904-a0c0-2bd56bf712d7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2.55375ccf-c733-4362-9e98-4864f3458144" returned: 0 in 0.272s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c831746f-06a8-4904-a0c0-2bd56bf712d7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:37 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2.info Jul 17 19:47:37 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:37 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c831746f-06a8-4904-a0c0-2bd56bf712d7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2.info" returned: 0 in 0.287s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:37 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-c831746f-06a8-4904-a0c0-2bd56bf712d7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2.info is being set with open permissions: ugo+rw Jul 17 19:47:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c831746f-06a8-4904-a0c0-2bd56bf712d7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:37 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2.info Jul 17 19:47:37 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:38 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c831746f-06a8-4904-a0c0-2bd56bf712d7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2.info" returned: 0 in 0.276s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c831746f-06a8-4904-a0c0-2bd56bf712d7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.178s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:38 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-c831746f-06a8-4904-a0c0-2bd56bf712d7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Create snapshot completed successfully Jul 17 19:47:38 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:47:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] Flow 'volume_create_manager' (3da61f7c-ab9e-4d01-b8b9-3f670bef2219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:47:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca262fec-4f02-4779-ad9d-c4af79e3b150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca262fec-4f02-4779-ad9d-c4af79e3b150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1355877362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6357ccb7-44cf-4e39-9384-8096cc700e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a62836445ab410986c9b257398d90a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:47:39Z,use_quota=True,user_id='91078a7a5f2747f68a59bd6a0dc8e0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0b070d-5394-4b61-892f-6fa1f844f134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0b070d-5394-4b61-892f-6fa1f844f134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d8d246-778a-468f-9df5-742266939f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d8d246-778a-468f-9df5-742266939f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6357ccb7-44cf-4e39-9384-8096cc700e31', 'volume_name': 'volume-6357ccb7-44cf-4e39-9384-8096cc700e31', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f0d5ea0-04d5-4137-88a4-15a70f411154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f0d5ea0-04d5-4137-88a4-15a70f411154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40be500f-c6cf-44b4-9c55-7079147aa23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:38 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] Volume 6357ccb7-44cf-4e39-9384-8096cc700e31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6357ccb7-44cf-4e39-9384-8096cc700e31', 'volume_size': 1} Jul 17 19:47:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:38 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1355877362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6357ccb7-44cf-4e39-9384-8096cc700e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a62836445ab410986c9b257398d90a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:47:39Z,use_quota=True,user_id='91078a7a5f2747f68a59bd6a0dc8e0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:47:38 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] Creating volume 6357ccb7-44cf-4e39-9384-8096cc700e31 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:47:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:38 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:47:38 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:47:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:38 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:47:38 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:47:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6357ccb7-44cf-4e39-9384-8096cc700e31 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:38 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6357ccb7-44cf-4e39-9384-8096cc700e31 1073741824 Jul 17 19:47:38 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:39 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5baf62c8-4fde-4b95-8598-f39cfedd9db7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Acquiring lock "cinder-55375ccf-c733-4362-9e98-4864f3458144-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:39 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5baf62c8-4fde-4b95-8598-f39cfedd9db7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Lock "cinder-55375ccf-c733-4362-9e98-4864f3458144-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:39 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5baf62c8-4fde-4b95-8598-f39cfedd9db7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Acquiring lock "cinder-quobyte-5cecb600-150e-4a4e-a7dd-2210485f8ea2" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:39 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5baf62c8-4fde-4b95-8598-f39cfedd9db7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Lock "cinder-quobyte-5cecb600-150e-4a4e-a7dd-2210485f8ea2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:39 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5baf62c8-4fde-4b95-8598-f39cfedd9db7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Acquiring lock "cinder-quobyte-55375ccf-c733-4362-9e98-4864f3458144" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:39 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5baf62c8-4fde-4b95-8598-f39cfedd9db7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Lock "cinder-quobyte-55375ccf-c733-4362-9e98-4864f3458144" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:39 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-5baf62c8-4fde-4b95-8598-f39cfedd9db7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Deleting offline snapshot 55375ccf-c733-4362-9e98-4864f3458144 of volume 5cecb600-150e-4a4e-a7dd-2210485f8ea2 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:47:39 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-5baf62c8-4fde-4b95-8598-f39cfedd9db7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] snapshot_file for this snap is: volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2.55375ccf-c733-4362-9e98-4864f3458144 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:47:39 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d116ff5-e1a4-4784-ba87-193488ad41d8]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:47:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5baf62c8-4fde-4b95-8598-f39cfedd9db7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2.55375ccf-c733-4362-9e98-4864f3458144 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:39 devstack sudo[99473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2.55375ccf-c733-4362-9e98-4864f3458144 Jul 17 19:47:39 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:39 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6357ccb7-44cf-4e39-9384-8096cc700e31 1073741824" returned: 0 in 0.529s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6357ccb7-44cf-4e39-9384-8096cc700e31 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:39 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6357ccb7-44cf-4e39-9384-8096cc700e31 Jul 17 19:47:39 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:39 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5baf62c8-4fde-4b95-8598-f39cfedd9db7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2.55375ccf-c733-4362-9e98-4864f3458144" returned: 0 in 0.594s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:39 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-5baf62c8-4fde-4b95-8598-f39cfedd9db7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:47:39 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6357ccb7-44cf-4e39-9384-8096cc700e31" returned: 0 in 0.349s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:39 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:47:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:39 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4fec79-b79a-427a-9613-a83e970ddd5f]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:47:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5baf62c8-4fde-4b95-8598-f39cfedd9db7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:39 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40be500f-c6cf-44b4-9c55-7079147aa23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6357ccb7-44cf-4e39-9384-8096cc700e31', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:39 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac43f27c-7e5d-45a6-885e-ee9966fae1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:39 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] Volume volume-6357ccb7-44cf-4e39-9384-8096cc700e31 (6357ccb7-44cf-4e39-9384-8096cc700e31): created successfully Jul 17 19:47:39 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac43f27c-7e5d-45a6-885e-ee9966fae1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:39 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] Flow 'volume_create_manager' (3da61f7c-ab9e-4d01-b8b9-3f670bef2219) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:47:39 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-4abfea2e-156e-4c14-ad28-64d8a69dc9c1 tempest-VolumesTransfersTest-5212078 None] Created volume successfully. Jul 17 19:47:40 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2 Jul 17 19:47:40 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:40 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5baf62c8-4fde-4b95-8598-f39cfedd9db7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2" returned: 0 in 0.405s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5baf62c8-4fde-4b95-8598-f39cfedd9db7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2.55375ccf-c733-4362-9e98-4864f3458144 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:40 devstack sudo[99487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2.55375ccf-c733-4362-9e98-4864f3458144 Jul 17 19:47:40 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:40 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5baf62c8-4fde-4b95-8598-f39cfedd9db7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2.55375ccf-c733-4362-9e98-4864f3458144" returned: 0 in 0.400s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5baf62c8-4fde-4b95-8598-f39cfedd9db7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2.55375ccf-c733-4362-9e98-4864f3458144 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:40 devstack sudo[99492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2.55375ccf-c733-4362-9e98-4864f3458144 Jul 17 19:47:40 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:41 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5baf62c8-4fde-4b95-8598-f39cfedd9db7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2.55375ccf-c733-4362-9e98-4864f3458144" returned: 0 in 0.302s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:41 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5baf62c8-4fde-4b95-8598-f39cfedd9db7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Lock "cinder-quobyte-55375ccf-c733-4362-9e98-4864f3458144" released by "_delete_snapshot" :: held 1.834s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:41 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5baf62c8-4fde-4b95-8598-f39cfedd9db7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Lock "cinder-quobyte-5cecb600-150e-4a4e-a7dd-2210485f8ea2" released by "delete_snapshot" :: held 1.865s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:41 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-5baf62c8-4fde-4b95-8598-f39cfedd9db7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Created reservations ['dedd128f-6d47-4e3b-8797-0bf827e5ac90', '3745befd-0936-48b1-9cbf-b1aa1e16dc47', 'b6f3eb32-0017-4f0f-be2a-6d09a14cf084', '7bf8a7c3-50eb-48b5-aee2-21ccbed7a4ff'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:47:41 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-5baf62c8-4fde-4b95-8598-f39cfedd9db7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Delete snapshot completed successfully. Jul 17 19:47:41 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5baf62c8-4fde-4b95-8598-f39cfedd9db7 tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Lock "cinder-55375ccf-c733-4362-9e98-4864f3458144-delete_snapshot" released by "delete_snapshot" :: held 2.060s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:41 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6d5076b9-d7fa-43b3-aaba-cb7e9b4532ca tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Acquiring lock "cinder-5cecb600-150e-4a4e-a7dd-2210485f8ea2-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:41 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6d5076b9-d7fa-43b3-aaba-cb7e9b4532ca tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Lock "cinder-5cecb600-150e-4a4e-a7dd-2210485f8ea2-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:41 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6d5076b9-d7fa-43b3-aaba-cb7e9b4532ca tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Acquiring lock "cinder-quobyte-5cecb600-150e-4a4e-a7dd-2210485f8ea2" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:41 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6d5076b9-d7fa-43b3-aaba-cb7e9b4532ca tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Lock "cinder-quobyte-5cecb600-150e-4a4e-a7dd-2210485f8ea2" acquired by "delete_volume" :: waited 0.037s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:41 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ebdaad-9d21-4aad-be37-e9d112b99472]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:47:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6d5076b9-d7fa-43b3-aaba-cb7e9b4532ca tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:41 devstack sudo[99495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2 Jul 17 19:47:41 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:42 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-2cc9cf44-8ef6-4600-9fc0-54185f79d2b3 tempest-VolumesTransfersTest-1786154654 None] Transfer volume completed successfully. Jul 17 19:47:42 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6d5076b9-d7fa-43b3-aaba-cb7e9b4532ca tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2" returned: 0 in 0.483s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6d5076b9-d7fa-43b3-aaba-cb7e9b4532ca tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:42 devstack sudo[99502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2 Jul 17 19:47:42 devstack sudo[99502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:42 devstack sudo[99502]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6d5076b9-d7fa-43b3-aaba-cb7e9b4532ca tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cecb600-150e-4a4e-a7dd-2210485f8ea2" returned: 0 in 0.313s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:42 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6d5076b9-d7fa-43b3-aaba-cb7e9b4532ca tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Lock "cinder-quobyte-5cecb600-150e-4a4e-a7dd-2210485f8ea2" released by "delete_volume" :: held 0.914s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:42 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2f304f7d-34f9-48d4-9aad-87c24df078eb tempest-VolumesTransfersTest-1804319272 None] Acquiring lock "cinder-6357ccb7-44cf-4e39-9384-8096cc700e31-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:42 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2f304f7d-34f9-48d4-9aad-87c24df078eb tempest-VolumesTransfersTest-1804319272 None] Lock "cinder-6357ccb7-44cf-4e39-9384-8096cc700e31-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:42 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2f304f7d-34f9-48d4-9aad-87c24df078eb tempest-VolumesTransfersTest-1804319272 None] Acquiring lock "cinder-quobyte-6357ccb7-44cf-4e39-9384-8096cc700e31" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:42 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-6d5076b9-d7fa-43b3-aaba-cb7e9b4532ca tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Created reservations ['31095ccf-f091-41fb-8908-d8192cb8c657', 'c9c7b5cd-b01d-49aa-9e8d-62d005c912d1', '43e4a0ca-0020-4821-b8cc-d01fdfa31a3c', '1af2cd5a-1203-4a95-88c0-1cc156923b42'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:47:42 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2f304f7d-34f9-48d4-9aad-87c24df078eb tempest-VolumesTransfersTest-1804319272 None] Lock "cinder-quobyte-6357ccb7-44cf-4e39-9384-8096cc700e31" acquired by "delete_volume" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:42 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85ac2e0-1551-4b51-ac77-853535b986cd]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:47:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2f304f7d-34f9-48d4-9aad-87c24df078eb tempest-VolumesTransfersTest-1804319272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6357ccb7-44cf-4e39-9384-8096cc700e31 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6d5076b9-d7fa-43b3-aaba-cb7e9b4532ca tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6d5076b9-d7fa-43b3-aaba-cb7e9b4532ca tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:42 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6d5076b9-d7fa-43b3-aaba-cb7e9b4532ca tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:47:42 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6d5076b9-d7fa-43b3-aaba-cb7e9b4532ca tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:47:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6d5076b9-d7fa-43b3-aaba-cb7e9b4532ca tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6d5076b9-d7fa-43b3-aaba-cb7e9b4532ca tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:42 devstack sudo[99506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:47:42 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:42 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6357ccb7-44cf-4e39-9384-8096cc700e31 Jul 17 19:47:42 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:43 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6d5076b9-d7fa-43b3-aaba-cb7e9b4532ca tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.311s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:43 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-6d5076b9-d7fa-43b3-aaba-cb7e9b4532ca tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:47:43 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-6d5076b9-d7fa-43b3-aaba-cb7e9b4532ca tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Deleted volume successfully. Jul 17 19:47:43 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6d5076b9-d7fa-43b3-aaba-cb7e9b4532ca tempest-VolumesSnapshotNegativeTestJSON-1332552828 None] Lock "cinder-5cecb600-150e-4a4e-a7dd-2210485f8ea2-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:43 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2f304f7d-34f9-48d4-9aad-87c24df078eb tempest-VolumesTransfersTest-1804319272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6357ccb7-44cf-4e39-9384-8096cc700e31" returned: 0 in 0.441s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2f304f7d-34f9-48d4-9aad-87c24df078eb tempest-VolumesTransfersTest-1804319272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6357ccb7-44cf-4e39-9384-8096cc700e31 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:43 devstack sudo[99513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6357ccb7-44cf-4e39-9384-8096cc700e31 Jul 17 19:47:43 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:43 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2f304f7d-34f9-48d4-9aad-87c24df078eb tempest-VolumesTransfersTest-1804319272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6357ccb7-44cf-4e39-9384-8096cc700e31" returned: 0 in 0.242s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:43 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2f304f7d-34f9-48d4-9aad-87c24df078eb tempest-VolumesTransfersTest-1804319272 None] Lock "cinder-quobyte-6357ccb7-44cf-4e39-9384-8096cc700e31" released by "delete_volume" :: held 0.733s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:43 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-2f304f7d-34f9-48d4-9aad-87c24df078eb tempest-VolumesTransfersTest-1804319272 None] Created reservations ['2e4a334f-8adc-445e-9127-44fb7f2f5976', 'b2a13231-62cc-4d85-a683-9a1f32ad81ad', '9ae7eadf-84a8-40eb-836b-64338b49b133', '21207745-2956-426d-bc57-c337962fc977'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:47:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-2f304f7d-34f9-48d4-9aad-87c24df078eb tempest-VolumesTransfersTest-1804319272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-2f304f7d-34f9-48d4-9aad-87c24df078eb tempest-VolumesTransfersTest-1804319272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:43 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-2f304f7d-34f9-48d4-9aad-87c24df078eb tempest-VolumesTransfersTest-1804319272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:47:43 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-2f304f7d-34f9-48d4-9aad-87c24df078eb tempest-VolumesTransfersTest-1804319272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:47:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-2f304f7d-34f9-48d4-9aad-87c24df078eb tempest-VolumesTransfersTest-1804319272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2f304f7d-34f9-48d4-9aad-87c24df078eb tempest-VolumesTransfersTest-1804319272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:43 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:47:43 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:43 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2f304f7d-34f9-48d4-9aad-87c24df078eb tempest-VolumesTransfersTest-1804319272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.273s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:43 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-2f304f7d-34f9-48d4-9aad-87c24df078eb tempest-VolumesTransfersTest-1804319272 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:47:43 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-2f304f7d-34f9-48d4-9aad-87c24df078eb tempest-VolumesTransfersTest-1804319272 None] Deleted volume successfully. Jul 17 19:47:43 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2f304f7d-34f9-48d4-9aad-87c24df078eb tempest-VolumesTransfersTest-1804319272 None] Lock "cinder-6357ccb7-44cf-4e39-9384-8096cc700e31-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:44 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:47:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] Flow 'volume_create_manager' (164fb573-4578-4282-97a5-cd9d7ec88a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:47:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e92ea357-3d50-4dac-baba-680cb6609f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e92ea357-3d50-4dac-baba-680cb6609f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1425665028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=259f38f1-eac9-4de4-85af-a39b621cba56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a62836445ab410986c9b257398d90a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:47:44Z,use_quota=True,user_id='91078a7a5f2747f68a59bd6a0dc8e0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (213e3166-9928-4b27-a78e-ff1ad540b526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (213e3166-9928-4b27-a78e-ff1ad540b526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (749e1666-0a12-4282-a908-5b1ff19c1112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (749e1666-0a12-4282-a908-5b1ff19c1112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '259f38f1-eac9-4de4-85af-a39b621cba56', 'volume_name': 'volume-259f38f1-eac9-4de4-85af-a39b621cba56', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e9aac04-7486-4a12-b79d-f6669f0e8acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e9aac04-7486-4a12-b79d-f6669f0e8acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670ccf95-9b03-41ec-a070-54c36bbf1ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:44 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] Volume 259f38f1-eac9-4de4-85af-a39b621cba56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-259f38f1-eac9-4de4-85af-a39b621cba56', 'volume_size': 1} Jul 17 19:47:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1425665028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=259f38f1-eac9-4de4-85af-a39b621cba56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a62836445ab410986c9b257398d90a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:47:44Z,use_quota=True,user_id='91078a7a5f2747f68a59bd6a0dc8e0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:47:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] Creating volume 259f38f1-eac9-4de4-85af-a39b621cba56 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:47:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:47:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:47:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:47:44 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:47:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-259f38f1-eac9-4de4-85af-a39b621cba56 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:44 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-259f38f1-eac9-4de4-85af-a39b621cba56 1073741824 Jul 17 19:47:44 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:45 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-259f38f1-eac9-4de4-85af-a39b621cba56 1073741824" returned: 0 in 0.537s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-259f38f1-eac9-4de4-85af-a39b621cba56 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:45 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-259f38f1-eac9-4de4-85af-a39b621cba56 Jul 17 19:47:45 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:45 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-259f38f1-eac9-4de4-85af-a39b621cba56" returned: 0 in 0.350s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:45 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:47:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670ccf95-9b03-41ec-a070-54c36bbf1ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-259f38f1-eac9-4de4-85af-a39b621cba56', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6639580-d28c-42ff-bc5d-92e972e5c14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:45 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] Volume volume-259f38f1-eac9-4de4-85af-a39b621cba56 (259f38f1-eac9-4de4-85af-a39b621cba56): created successfully Jul 17 19:47:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6639580-d28c-42ff-bc5d-92e972e5c14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] Flow 'volume_create_manager' (164fb573-4578-4282-97a5-cd9d7ec88a6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:47:45 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-479115c9-46b4-48da-9e3d-e82b79e5a325 tempest-VolumesTransfersTest-5212078 None] Created volume successfully. Jul 17 19:47:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-3adc5168-a4ff-4f93-a996-dbe7d303baef tempest-VolumesTransfersTest-1804319272 None] Acquiring lock "cinder-259f38f1-eac9-4de4-85af-a39b621cba56-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-3adc5168-a4ff-4f93-a996-dbe7d303baef tempest-VolumesTransfersTest-1804319272 None] Lock "cinder-259f38f1-eac9-4de4-85af-a39b621cba56-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-3adc5168-a4ff-4f93-a996-dbe7d303baef tempest-VolumesTransfersTest-1804319272 None] Acquiring lock "cinder-quobyte-259f38f1-eac9-4de4-85af-a39b621cba56" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:47:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-3adc5168-a4ff-4f93-a996-dbe7d303baef tempest-VolumesTransfersTest-1804319272 None] Lock "cinder-quobyte-259f38f1-eac9-4de4-85af-a39b621cba56" acquired by "delete_volume" :: waited 0.017s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:47:47 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba5f40a-7b30-40d0-8e13-c8560af8ae31]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:47:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-3adc5168-a4ff-4f93-a996-dbe7d303baef tempest-VolumesTransfersTest-1804319272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-259f38f1-eac9-4de4-85af-a39b621cba56 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:47 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-259f38f1-eac9-4de4-85af-a39b621cba56 Jul 17 19:47:47 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:47 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-3adc5168-a4ff-4f93-a996-dbe7d303baef tempest-VolumesTransfersTest-1804319272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-259f38f1-eac9-4de4-85af-a39b621cba56" returned: 0 in 0.423s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-3adc5168-a4ff-4f93-a996-dbe7d303baef tempest-VolumesTransfersTest-1804319272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-259f38f1-eac9-4de4-85af-a39b621cba56 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:47 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-259f38f1-eac9-4de4-85af-a39b621cba56 Jul 17 19:47:47 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:47 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-3adc5168-a4ff-4f93-a996-dbe7d303baef tempest-VolumesTransfersTest-1804319272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-259f38f1-eac9-4de4-85af-a39b621cba56" returned: 0 in 0.311s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-3adc5168-a4ff-4f93-a996-dbe7d303baef tempest-VolumesTransfersTest-1804319272 None] Lock "cinder-quobyte-259f38f1-eac9-4de4-85af-a39b621cba56" released by "delete_volume" :: held 0.779s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:47 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-3adc5168-a4ff-4f93-a996-dbe7d303baef tempest-VolumesTransfersTest-1804319272 None] Created reservations ['1326d719-b723-4645-ba11-a7f3ba5c318e', '4f2afa69-89fa-43dc-a5f8-f5b23c91441e', '0c0c4dd4-0e26-4660-afa3-0a5d27b2520a', '2f9dc92d-63d9-4ba2-b72b-9a77e9d8c516'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:47:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-3adc5168-a4ff-4f93-a996-dbe7d303baef tempest-VolumesTransfersTest-1804319272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-3adc5168-a4ff-4f93-a996-dbe7d303baef tempest-VolumesTransfersTest-1804319272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:48 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-3adc5168-a4ff-4f93-a996-dbe7d303baef tempest-VolumesTransfersTest-1804319272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:47:48 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-3adc5168-a4ff-4f93-a996-dbe7d303baef tempest-VolumesTransfersTest-1804319272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:47:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-3adc5168-a4ff-4f93-a996-dbe7d303baef tempest-VolumesTransfersTest-1804319272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-3adc5168-a4ff-4f93-a996-dbe7d303baef tempest-VolumesTransfersTest-1804319272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:48 devstack sudo[99536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:47:48 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:48 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-3adc5168-a4ff-4f93-a996-dbe7d303baef tempest-VolumesTransfersTest-1804319272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.349s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:48 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-3adc5168-a4ff-4f93-a996-dbe7d303baef tempest-VolumesTransfersTest-1804319272 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:47:48 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-3adc5168-a4ff-4f93-a996-dbe7d303baef tempest-VolumesTransfersTest-1804319272 None] Deleted volume successfully. Jul 17 19:47:48 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-3adc5168-a4ff-4f93-a996-dbe7d303baef tempest-VolumesTransfersTest-1804319272 None] Lock "cinder-259f38f1-eac9-4de4-85af-a39b621cba56-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:47:55 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:47:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Flow 'volume_create_manager' (e3623730-45db-429c-92f0-3537c9412509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:47:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd873758-8e12-46d1-8ca6-c5f227c9acb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd873758-8e12-46d1-8ca6-c5f227c9acb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1266677075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98533999-6ce0-42da-8dd3-d57abf58cbe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4afa97e461c74a3e9141dc817faa737e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:47:56Z,use_quota=True,user_id='beaf9ae951c4425cbdb76629e17a6c82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da4686c5-56c0-49b9-b37d-41c796f86176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da4686c5-56c0-49b9-b37d-41c796f86176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73100534-e623-435c-a0ea-aa048566bf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73100534-e623-435c-a0ea-aa048566bf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98533999-6ce0-42da-8dd3-d57abf58cbe6', 'volume_name': 'volume-98533999-6ce0-42da-8dd3-d57abf58cbe6', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd60b50a-a2d1-4752-a365-062ace2c97cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd60b50a-a2d1-4752-a365-062ace2c97cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0934670-ad32-42a5-9d3f-74db737c1682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:55 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Volume 98533999-6ce0-42da-8dd3-d57abf58cbe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98533999-6ce0-42da-8dd3-d57abf58cbe6', 'volume_size': 1} Jul 17 19:47:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:55 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1266677075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98533999-6ce0-42da-8dd3-d57abf58cbe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4afa97e461c74a3e9141dc817faa737e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:47:56Z,use_quota=True,user_id='beaf9ae951c4425cbdb76629e17a6c82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:47:55 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Creating volume 98533999-6ce0-42da-8dd3-d57abf58cbe6 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:47:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:55 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:47:55 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:47:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:55 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:47:55 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:47:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98533999-6ce0-42da-8dd3-d57abf58cbe6 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:55 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98533999-6ce0-42da-8dd3-d57abf58cbe6 1073741824 Jul 17 19:47:55 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:56 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:47:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Flow 'volume_create_manager' (3ed744f7-a0e1-43ab-a09b-f71a427d3179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:47:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60b9278-8be6-4729-b4aa-1fe46d930dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60b9278-8be6-4729-b4aa-1fe46d930dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1316984118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d456eff0-f060-4e1d-bbcc-11b64e60aef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4afa97e461c74a3e9141dc817faa737e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:47:56Z,use_quota=True,user_id='beaf9ae951c4425cbdb76629e17a6c82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (213e68da-260f-4cc0-baf3-d42c1b92e9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (213e68da-260f-4cc0-baf3-d42c1b92e9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad65efe-0ab3-4e9c-acb6-aa83d8a39fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad65efe-0ab3-4e9c-acb6-aa83d8a39fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd456eff0-f060-4e1d-bbcc-11b64e60aef6', 'volume_name': 'volume-d456eff0-f060-4e1d-bbcc-11b64e60aef6', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9065b522-4965-460a-ac0c-ce0c03825b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9065b522-4965-460a-ac0c-ce0c03825b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2e0c4f-16e3-49ed-a35d-167a666c8949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:56 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Volume d456eff0-f060-4e1d-bbcc-11b64e60aef6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d456eff0-f060-4e1d-bbcc-11b64e60aef6', 'volume_size': 1} Jul 17 19:47:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:56 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98533999-6ce0-42da-8dd3-d57abf58cbe6 1073741824" returned: 0 in 0.738s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98533999-6ce0-42da-8dd3-d57abf58cbe6 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:56 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98533999-6ce0-42da-8dd3-d57abf58cbe6 Jul 17 19:47:56 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:56 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98533999-6ce0-42da-8dd3-d57abf58cbe6" returned: 0 in 0.338s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:56 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:47:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.413s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:57 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1316984118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d456eff0-f060-4e1d-bbcc-11b64e60aef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4afa97e461c74a3e9141dc817faa737e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:47:56Z,use_quota=True,user_id='beaf9ae951c4425cbdb76629e17a6c82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:47:57 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Creating volume d456eff0-f060-4e1d-bbcc-11b64e60aef6 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:47:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:47:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:47:57 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:47:57 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:47:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:57 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:47:57 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:47:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d456eff0-f060-4e1d-bbcc-11b64e60aef6 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0934670-ad32-42a5-9d3f-74db737c1682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98533999-6ce0-42da-8dd3-d57abf58cbe6', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:57 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d456eff0-f060-4e1d-bbcc-11b64e60aef6 1073741824 Jul 17 19:47:57 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59ae0997-e890-46fa-ba06-31f8f3a8285e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:57 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Volume volume-98533999-6ce0-42da-8dd3-d57abf58cbe6 (98533999-6ce0-42da-8dd3-d57abf58cbe6): created successfully Jul 17 19:47:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59ae0997-e890-46fa-ba06-31f8f3a8285e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Flow 'volume_create_manager' (e3623730-45db-429c-92f0-3537c9412509) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:47:57 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-fe1664df-4a14-4096-8a22-50d54113c765 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Created volume successfully. Jul 17 19:47:57 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d456eff0-f060-4e1d-bbcc-11b64e60aef6 1073741824" returned: 0 in 0.708s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d456eff0-f060-4e1d-bbcc-11b64e60aef6 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:47:57 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d456eff0-f060-4e1d-bbcc-11b64e60aef6 Jul 17 19:47:57 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:47:58 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Jul 17 19:47:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d456eff0-f060-4e1d-bbcc-11b64e60aef6" returned: 0 in 0.360s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:47:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:47:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:47:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2e0c4f-16e3-49ed-a35d-167a666c8949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d456eff0-f060-4e1d-bbcc-11b64e60aef6', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55af486f-086a-441b-9f5e-e63cfc9e2152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:47:58 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Volume volume-d456eff0-f060-4e1d-bbcc-11b64e60aef6 (d456eff0-f060-4e1d-bbcc-11b64e60aef6): created successfully Jul 17 19:47:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55af486f-086a-441b-9f5e-e63cfc9e2152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:47:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Flow 'volume_create_manager' (3ed744f7-a0e1-43ab-a09b-f71a427d3179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:47:58 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-d4e70e50-fc3f-4fab-83ce-53332787e699 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Created volume successfully. Jul 17 19:48:08 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=107,cinder:INSERT=33,cinder:UPDATE=143,cinder:DELETE=11 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:48:08 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=109,cinder:INSERT=39,cinder:UPDATE=146,cinder:DELETE=14 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:48:11 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:48:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] Flow 'volume_create_manager' (5423dd03-61fa-4063-aac3-58ca0038a9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:48:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caea77f8-3797-4545-8838-b37ba19a6f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:48:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caea77f8-3797-4545-8838-b37ba19a6f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-443817373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8636e464-b450-4e00-96af-1b889fb9d3d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9802be364d6f450d8603e46bcccc415a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:48:11Z,use_quota=True,user_id='f35635b2aca14288af6ebe8608cc395f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:48:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b3a1b34-6fae-4317-ac78-f3fc3e857f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:48:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b3a1b34-6fae-4317-ac78-f3fc3e857f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:48:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77374d74-a706-4e75-bea5-eb11cdbf759c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:48:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77374d74-a706-4e75-bea5-eb11cdbf759c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8636e464-b450-4e00-96af-1b889fb9d3d0', 'volume_name': 'volume-8636e464-b450-4e00-96af-1b889fb9d3d0', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:48:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (162be8b9-4bda-4f2a-91a4-be3d813a879a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:48:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (162be8b9-4bda-4f2a-91a4-be3d813a879a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:48:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c19e75f-fda1-49ef-b592-aca922011fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:48:11 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] Volume 8636e464-b450-4e00-96af-1b889fb9d3d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8636e464-b450-4e00-96af-1b889fb9d3d0', 'volume_size': 1} Jul 17 19:48:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:48:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:48:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-443817373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8636e464-b450-4e00-96af-1b889fb9d3d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9802be364d6f450d8603e46bcccc415a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:48:11Z,use_quota=True,user_id='f35635b2aca14288af6ebe8608cc395f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:48:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] Creating volume 8636e464-b450-4e00-96af-1b889fb9d3d0 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:48:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:48:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:48:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:48:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:48:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:48:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:48:11 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:48:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:48:11 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0 1073741824 Jul 17 19:48:11 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:48:11 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Jul 17 19:48:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0 1073741824" returned: 0 in 0.554s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:48:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:48:11 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0 Jul 17 19:48:11 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:48:12 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Jul 17 19:48:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0" returned: 0 in 0.268s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:48:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:48:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:48:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c19e75f-fda1-49ef-b592-aca922011fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8636e464-b450-4e00-96af-1b889fb9d3d0', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:48:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428342ec-93b7-49b5-9d62-047287f95e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:48:12 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] Volume volume-8636e464-b450-4e00-96af-1b889fb9d3d0 (8636e464-b450-4e00-96af-1b889fb9d3d0): created successfully Jul 17 19:48:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428342ec-93b7-49b5-9d62-047287f95e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:48:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] Flow 'volume_create_manager' (5423dd03-61fa-4063-aac3-58ca0038a9d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:48:12 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-b250837c-3c57-4bc5-a321-3971fa6fb3c2 tempest-VolumesActionsTest-1940405618 None] Created volume successfully. Jul 17 19:48:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:48:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:48:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:48:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:48:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:48:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:48:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:48:15 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:48:15 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:48:15 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Jul 17 19:48:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.374s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:48:15 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:48:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager._thread_info {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:48:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread count: 28 {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 19:48:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread info: [<_MainThread(MainThread, started 130066227544192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 19:48:22 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:48:22 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:UPDATE=5,cinder:SELECT=2 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:48:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a597e36d-8d22-47de-9ae7-76be6c6095b6 tempest-VolumesActionsTest-1940405618 None] Acquiring lock "cinder-8636e464-b450-4e00-96af-1b889fb9d3d0" by "attach_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:48:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a597e36d-8d22-47de-9ae7-76be6c6095b6 tempest-VolumesActionsTest-1940405618 None] Lock "cinder-8636e464-b450-4e00-96af-1b889fb9d3d0" acquired by "attach_volume" :: waited 0.025s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:48:26 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-a597e36d-8d22-47de-9ae7-76be6c6095b6 tempest-VolumesActionsTest-1940405618 None] Attaching volume 8636e464-b450-4e00-96af-1b889fb9d3d0 to instance ab77e1bb-04df-4816-a09e-b55ae50f12fa at mountpoint /dev/vdb on host None. Jul 17 19:48:26 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-a597e36d-8d22-47de-9ae7-76be6c6095b6 tempest-VolumesActionsTest-1940405618 None] Attach volume completed successfully. Jul 17 19:48:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a597e36d-8d22-47de-9ae7-76be6c6095b6 tempest-VolumesActionsTest-1940405618 None] Lock "cinder-8636e464-b450-4e00-96af-1b889fb9d3d0" released by "attach_volume" :: held 0.162s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:48:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-4587db0c-0ebb-4266-b357-62fb56d8dc4d tempest-VolumesActionsTest-1940405618 None] Acquiring lock "cinder-8636e464-b450-4e00-96af-1b889fb9d3d0-detach_volume" by "detach_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:48:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-4587db0c-0ebb-4266-b357-62fb56d8dc4d tempest-VolumesActionsTest-1940405618 None] Lock "cinder-8636e464-b450-4e00-96af-1b889fb9d3d0-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:48:27 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-4587db0c-0ebb-4266-b357-62fb56d8dc4d tempest-VolumesActionsTest-1940405618 None] Detaching volume 8636e464-b450-4e00-96af-1b889fb9d3d0 from instance ab77e1bb-04df-4816-a09e-b55ae50f12fa. Jul 17 19:48:27 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-4587db0c-0ebb-4266-b357-62fb56d8dc4d tempest-VolumesActionsTest-1940405618 None] Detach volume completed successfully. Jul 17 19:48:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-4587db0c-0ebb-4266-b357-62fb56d8dc4d tempest-VolumesActionsTest-1940405618 None] Lock "cinder-8636e464-b450-4e00-96af-1b889fb9d3d0-detach_volume" released by "detach_volume" :: held 0.074s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:48:37 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:INSERT=1,cinder:SELECT=6,cinder:UPDATE=3 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:48:37 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:48:40 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-3070769b-d9f0-4299-8bc9-d4ce52ff9611 tempest-VolumesActionsTest-1940405618 None] Acquiring lock "cinder-8636e464-b450-4e00-96af-1b889fb9d3d0" by "attach_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:48:40 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-3070769b-d9f0-4299-8bc9-d4ce52ff9611 tempest-VolumesActionsTest-1940405618 None] Lock "cinder-8636e464-b450-4e00-96af-1b889fb9d3d0" acquired by "attach_volume" :: waited 0.041s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:48:40 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-3070769b-d9f0-4299-8bc9-d4ce52ff9611 tempest-VolumesActionsTest-1940405618 None] Attaching volume 8636e464-b450-4e00-96af-1b889fb9d3d0 to instance 3a5e476b-41e2-4871-8a5a-948f2fdb6caf at mountpoint /dev/vdb on host None. Jul 17 19:48:40 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-3070769b-d9f0-4299-8bc9-d4ce52ff9611 tempest-VolumesActionsTest-1940405618 None] Attach volume completed successfully. Jul 17 19:48:40 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-3070769b-d9f0-4299-8bc9-d4ce52ff9611 tempest-VolumesActionsTest-1940405618 None] Lock "cinder-8636e464-b450-4e00-96af-1b889fb9d3d0" released by "attach_volume" :: held 0.144s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:48:40 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0ae10a83-48b5-44c4-853a-b396fde52c47 tempest-VolumesActionsTest-1940405618 None] Acquiring lock "cinder-8636e464-b450-4e00-96af-1b889fb9d3d0-detach_volume" by "detach_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:48:40 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0ae10a83-48b5-44c4-853a-b396fde52c47 tempest-VolumesActionsTest-1940405618 None] Lock "cinder-8636e464-b450-4e00-96af-1b889fb9d3d0-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:48:40 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-0ae10a83-48b5-44c4-853a-b396fde52c47 tempest-VolumesActionsTest-1940405618 None] Detaching volume 8636e464-b450-4e00-96af-1b889fb9d3d0 from instance 3a5e476b-41e2-4871-8a5a-948f2fdb6caf. Jul 17 19:48:40 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-0ae10a83-48b5-44c4-853a-b396fde52c47 tempest-VolumesActionsTest-1940405618 None] Detach volume completed successfully. Jul 17 19:48:40 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0ae10a83-48b5-44c4-853a-b396fde52c47 tempest-VolumesActionsTest-1940405618 None] Lock "cinder-8636e464-b450-4e00-96af-1b889fb9d3d0-detach_volume" released by "detach_volume" :: held 0.063s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:48:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-01f730e7-3a60-43cc-99ab-1eeb64f827e3 req-c4cab5d5-06f9-4005-b16e-3b318119325a tempest-TestServerVolumeAttachmentScenario-1644221099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:48:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-01f730e7-3a60-43cc-99ab-1eeb64f827e3 req-c4cab5d5-06f9-4005-b16e-3b318119325a tempest-TestServerVolumeAttachmentScenario-1644221099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:48:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-01f730e7-3a60-43cc-99ab-1eeb64f827e3 req-c4cab5d5-06f9-4005-b16e-3b318119325a tempest-TestServerVolumeAttachmentScenario-1644221099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:48:43 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-01f730e7-3a60-43cc-99ab-1eeb64f827e3 req-c4cab5d5-06f9-4005-b16e-3b318119325a tempest-TestServerVolumeAttachmentScenario-1644221099 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55', 'name': 'volume-98533999-6ce0-42da-8dd3-d57abf58cbe6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a1db036-76dc-4795-a894-7c4928de1b9f', 'enforce_multipath': True} {{(pid=87726) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 19:48:43 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-01f730e7-3a60-43cc-99ab-1eeb64f827e3 req-c4cab5d5-06f9-4005-b16e-3b318119325a tempest-TestServerVolumeAttachmentScenario-1644221099 None] attachment_update completed successfully. Jul 17 19:48:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e5232abb-4dcd-4ddb-ae8d-ae13a1488166 tempest-VolumesActionsTest-1940405618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:48:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e5232abb-4dcd-4ddb-ae8d-ae13a1488166 tempest-VolumesActionsTest-1940405618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:48:45 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3bf080-6a65-4035-958c-4bdc6c23ae00]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:48:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e5232abb-4dcd-4ddb-ae8d-ae13a1488166 tempest-VolumesActionsTest-1940405618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:48:45 devstack sudo[100450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0 Jul 17 19:48:45 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:48:45 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root Jul 17 19:48:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e5232abb-4dcd-4ddb-ae8d-ae13a1488166 tempest-VolumesActionsTest-1940405618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0" returned: 0 in 0.380s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:48:45 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb82e3dc-4142-4a32-9181-09c4d2d2a446]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:48:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e5232abb-4dcd-4ddb-ae8d-ae13a1488166 tempest-VolumesActionsTest-1940405618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:48:46 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0 Jul 17 19:48:46 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:48:46 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Jul 17 19:48:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e5232abb-4dcd-4ddb-ae8d-ae13a1488166 tempest-VolumesActionsTest-1940405618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0" returned: 0 in 0.408s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:48:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e5232abb-4dcd-4ddb-ae8d-ae13a1488166 tempest-VolumesActionsTest-1940405618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0 /opt/stack/data/cinder/conversion/8636e464-b450-4e00-96af-1b889fb9d3d0.temp_image.cbc3459a-34a8-4ea3-9ad6-4800df044ac7lsk1tt5b.img {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:48:46 devstack sudo[100460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0 /opt/stack/data/cinder/conversion/8636e464-b450-4e00-96af-1b889fb9d3d0.temp_image.cbc3459a-34a8-4ea3-9ad6-4800df044ac7lsk1tt5b.img Jul 17 19:48:46 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:48:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-a1f56791-0d1a-4a68-82f2-4c410ccd668b req-8fcf49d8-038f-4d82-b526-8e3e7d75a105 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:48:51 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root Jul 17 19:48:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e5232abb-4dcd-4ddb-ae8d-ae13a1488166 tempest-VolumesActionsTest-1940405618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0 /opt/stack/data/cinder/conversion/8636e464-b450-4e00-96af-1b889fb9d3d0.temp_image.cbc3459a-34a8-4ea3-9ad6-4800df044ac7lsk1tt5b.img" returned: 0 in 4.750s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:48:51 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9acb119-c3b5-4555-bea9-801594681b1f]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:48:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e5232abb-4dcd-4ddb-ae8d-ae13a1488166 tempest-VolumesActionsTest-1940405618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:48:51 devstack sudo[100545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0 Jul 17 19:48:51 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:48:51 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root Jul 17 19:48:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e5232abb-4dcd-4ddb-ae8d-ae13a1488166 tempest-VolumesActionsTest-1940405618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0" returned: 0 in 0.497s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:48:51 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-e5232abb-4dcd-4ddb-ae8d-ae13a1488166 tempest-VolumesActionsTest-1940405618 None] Image conversion details: src /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0, size 1024.00 MB, duration 4.75 sec, destination /opt/stack/data/cinder/conversion/8636e464-b450-4e00-96af-1b889fb9d3d0.temp_image.cbc3459a-34a8-4ea3-9ad6-4800df044ac7lsk1tt5b.img {{(pid=87726) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 19:48:51 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-e5232abb-4dcd-4ddb-ae8d-ae13a1488166 tempest-VolumesActionsTest-1940405618 None] Converted 1024.00 MB image at 215.55 MB/s Jul 17 19:48:51 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-e5232abb-4dcd-4ddb-ae8d-ae13a1488166 tempest-VolumesActionsTest-1940405618 None] cbc3459a-34a8-4ea3-9ad6-4800df044ac7 was raw, no need to convert to raw {{(pid=87726) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 17 19:48:58 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:48:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Flow 'volume_create_manager' (46fddd51-ec3e-4734-b746-63e9f24c1e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:48:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73cf19fa-7880-4c4a-ae35-cda90877e355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:48:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73cf19fa-7880-4c4a-ae35-cda90877e355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1641518879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf34482-c7f9-457d-beec-9616b8996ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bceb873b8cb64f27b0f24b6ab99209e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:48:58Z,use_quota=True,user_id='2bab431a430f4e4daa9aaca155337c81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:48:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0aae572-058c-4645-8642-084726b04e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:48:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0aae572-058c-4645-8642-084726b04e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:48:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f68d66c-874d-407e-b41d-f6b93a0b1e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:48:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f68d66c-874d-407e-b41d-f6b93a0b1e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bf34482-c7f9-457d-beec-9616b8996ff4', 'volume_name': 'volume-5bf34482-c7f9-457d-beec-9616b8996ff4', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:48:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5097d1-c2bb-4930-9449-e0634e972db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:48:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5097d1-c2bb-4930-9449-e0634e972db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:48:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed76626-a030-43d9-85b5-b7d5f8a476b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:48:58 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Volume 5bf34482-c7f9-457d-beec-9616b8996ff4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bf34482-c7f9-457d-beec-9616b8996ff4', 'volume_size': 1} Jul 17 19:48:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:49:08 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=21,cinder:UPDATE=5 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:49:08 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:INSERT=2,cinder:UPDATE=5,cinder:SELECT=12 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:49:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e5232abb-4dcd-4ddb-ae8d-ae13a1488166 tempest-VolumesActionsTest-1940405618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.796s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e5232abb-4dcd-4ddb-ae8d-ae13a1488166 tempest-VolumesActionsTest-1940405618 None] Uploaded volume to glance image-id: cbc3459a-34a8-4ea3-9ad6-4800df044ac7. {{(pid=87726) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 17 19:49:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-a1f56791-0d1a-4a68-82f2-4c410ccd668b req-8fcf49d8-038f-4d82-b526-8e3e7d75a105 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 19.234s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-a1f56791-0d1a-4a68-82f2-4c410ccd668b req-8fcf49d8-038f-4d82-b526-8e3e7d75a105 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.280s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1641518879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf34482-c7f9-457d-beec-9616b8996ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bceb873b8cb64f27b0f24b6ab99209e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:48:58Z,use_quota=True,user_id='2bab431a430f4e4daa9aaca155337c81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:49:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Creating volume 5bf34482-c7f9-457d-beec-9616b8996ff4 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:49:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:49:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:49:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:49:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:49:10 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:49:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5bf34482-c7f9-457d-beec-9616b8996ff4 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:10 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e5232abb-4dcd-4ddb-ae8d-ae13a1488166 tempest-VolumesActionsTest-1940405618 None] Copy volume to image completed successfully. Jul 17 19:49:10 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5bf34482-c7f9-457d-beec-9616b8996ff4 1073741824 Jul 17 19:49:10 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-a1f56791-0d1a-4a68-82f2-4c410ccd668b req-8fcf49d8-038f-4d82-b526-8e3e7d75a105 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55', 'name': 'volume-d456eff0-f060-4e1d-bbcc-11b64e60aef6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4138ffdf-7ff9-4f76-b8d5-bb2cdc1a9d6b', 'enforce_multipath': True} {{(pid=87726) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 19:49:10 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-a1f56791-0d1a-4a68-82f2-4c410ccd668b req-8fcf49d8-038f-4d82-b526-8e3e7d75a105 tempest-TestServerVolumeAttachmentScenario-1644221099 None] attachment_update completed successfully. Jul 17 19:49:10 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5bf34482-c7f9-457d-beec-9616b8996ff4 1073741824" returned: 0 in 0.560s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5bf34482-c7f9-457d-beec-9616b8996ff4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:11 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5bf34482-c7f9-457d-beec-9616b8996ff4 Jul 17 19:49:11 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:11 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5bf34482-c7f9-457d-beec-9616b8996ff4" returned: 0 in 0.279s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:49:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed76626-a030-43d9-85b5-b7d5f8a476b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bf34482-c7f9-457d-beec-9616b8996ff4', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe1b8fa-f9bf-4eac-8cf6-4a2df039e6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:11 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Volume volume-5bf34482-c7f9-457d-beec-9616b8996ff4 (5bf34482-c7f9-457d-beec-9616b8996ff4): created successfully Jul 17 19:49:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe1b8fa-f9bf-4eac-8cf6-4a2df039e6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Flow 'volume_create_manager' (46fddd51-ec3e-4734-b746-63e9f24c1e06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:49:11 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e7f5925b-139b-473a-a8dd-2219014d42f9 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Created volume successfully. Jul 17 19:49:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c2c4990d-9288-4565-9155-4f4e07dd6665 tempest-VolumesActionsTest-1940405618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:49:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c2c4990d-9288-4565-9155-4f4e07dd6665 tempest-VolumesActionsTest-1940405618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:11 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e6a34b-0cc3-4cc0-bec2-d0980a76d0e2]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:49:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c2c4990d-9288-4565-9155-4f4e07dd6665 tempest-VolumesActionsTest-1940405618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:11 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0 Jul 17 19:49:11 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:12 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-a0efc8b4-25c9-400e-a4aa-8f14e81072e2 req-fec4627b-732a-4f77-9a0a-16d8de1b03af tempest-TestServerVolumeAttachmentScenario-1644221099 None] Terminate volume connection completed successfully. Jul 17 19:49:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-a0efc8b4-25c9-400e-a4aa-8f14e81072e2 req-fec4627b-732a-4f77-9a0a-16d8de1b03af tempest-TestServerVolumeAttachmentScenario-1644221099 None] Deleting attachment 4138ffdf-7ff9-4f76-b8d5-bb2cdc1a9d6b. {{(pid=87726) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 19:49:12 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c2c4990d-9288-4565-9155-4f4e07dd6665 tempest-VolumesActionsTest-1940405618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0" returned: 0 in 0.409s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:12 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3a2da6-e388-41c0-866f-b20de9a20d5d]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:49:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c2c4990d-9288-4565-9155-4f4e07dd6665 tempest-VolumesActionsTest-1940405618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:12 devstack sudo[100608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0 Jul 17 19:49:12 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:12 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c2c4990d-9288-4565-9155-4f4e07dd6665 tempest-VolumesActionsTest-1940405618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0" returned: 0 in 0.373s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c2c4990d-9288-4565-9155-4f4e07dd6665 tempest-VolumesActionsTest-1940405618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0 /opt/stack/data/cinder/conversion/8636e464-b450-4e00-96af-1b889fb9d3d0.temp_image.724fec01-e9a7-460e-82cb-837dfb146add9ab6htuw.img {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:12 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0 /opt/stack/data/cinder/conversion/8636e464-b450-4e00-96af-1b889fb9d3d0.temp_image.724fec01-e9a7-460e-82cb-837dfb146add9ab6htuw.img Jul 17 19:49:12 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-1d41c098-4cc5-4a31-b993-ca195effad3e req-33b6beb5-f69e-4670-86db-ec13e3b96fba tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:49:14 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-f97a899f-2da2-486d-85d6-860aae2aa3e0 req-cdee69b7-95c9-457f-8c18-cc7c9995a30f tempest-TestServerVolumeAttachmentScenario-1644221099 None] Terminate volume connection completed successfully. Jul 17 19:49:14 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-f97a899f-2da2-486d-85d6-860aae2aa3e0 req-cdee69b7-95c9-457f-8c18-cc7c9995a30f tempest-TestServerVolumeAttachmentScenario-1644221099 None] Deleting attachment 5a1db036-76dc-4795-a894-7c4928de1b9f. {{(pid=87726) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 19:49:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:49:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:49:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:49:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:49:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:15 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:49:15 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:15 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.410s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:15 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:49:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager._thread_info {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:49:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread count: 28 {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 19:49:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread info: [<_MainThread(MainThread, started 130066227544192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 19:49:17 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c2c4990d-9288-4565-9155-4f4e07dd6665 tempest-VolumesActionsTest-1940405618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0 /opt/stack/data/cinder/conversion/8636e464-b450-4e00-96af-1b889fb9d3d0.temp_image.724fec01-e9a7-460e-82cb-837dfb146add9ab6htuw.img" returned: 0 in 4.950s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:17 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[566782f9-0084-4962-b144-aaea7bce7972]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:49:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c2c4990d-9288-4565-9155-4f4e07dd6665 tempest-VolumesActionsTest-1940405618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:17 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0 Jul 17 19:49:17 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:18 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c2c4990d-9288-4565-9155-4f4e07dd6665 tempest-VolumesActionsTest-1940405618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0" returned: 0 in 0.652s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:18 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-c2c4990d-9288-4565-9155-4f4e07dd6665 tempest-VolumesActionsTest-1940405618 None] Image conversion details: src /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0, size 1024.00 MB, duration 4.95 sec, destination /opt/stack/data/cinder/conversion/8636e464-b450-4e00-96af-1b889fb9d3d0.temp_image.724fec01-e9a7-460e-82cb-837dfb146add9ab6htuw.img {{(pid=87726) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 19:49:18 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-c2c4990d-9288-4565-9155-4f4e07dd6665 tempest-VolumesActionsTest-1940405618 None] Converted 1024.00 MB image at 206.81 MB/s Jul 17 19:49:18 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-c2c4990d-9288-4565-9155-4f4e07dd6665 tempest-VolumesActionsTest-1940405618 None] 724fec01-e9a7-460e-82cb-837dfb146add was raw, converting to qcow2 {{(pid=87726) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 17 19:49:18 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[e107d95e-1f63-461e-a0e4-6fffd33a08b1]: (4, 'raw') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:49:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c2c4990d-9288-4565-9155-4f4e07dd6665 tempest-VolumesActionsTest-1940405618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8636e464-b450-4e00-96af-1b889fb9d3d0.temp_image.724fec01-e9a7-460e-82cb-837dfb146add9ab6htuw.img {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:18 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8636e464-b450-4e00-96af-1b889fb9d3d0.temp_image.724fec01-e9a7-460e-82cb-837dfb146add9ab6htuw.img Jul 17 19:49:18 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:18 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c2c4990d-9288-4565-9155-4f4e07dd6665 tempest-VolumesActionsTest-1940405618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8636e464-b450-4e00-96af-1b889fb9d3d0.temp_image.724fec01-e9a7-460e-82cb-837dfb146add9ab6htuw.img" returned: 0 in 0.375s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c2c4990d-9288-4565-9155-4f4e07dd6665 tempest-VolumesActionsTest-1940405618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8636e464-b450-4e00-96af-1b889fb9d3d0.temp_image.724fec01-e9a7-460e-82cb-837dfb146add9ab6htuw.img {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:18 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8636e464-b450-4e00-96af-1b889fb9d3d0.temp_image.724fec01-e9a7-460e-82cb-837dfb146add9ab6htuw.img Jul 17 19:49:18 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:18 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c2c4990d-9288-4565-9155-4f4e07dd6665 tempest-VolumesActionsTest-1940405618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8636e464-b450-4e00-96af-1b889fb9d3d0.temp_image.724fec01-e9a7-460e-82cb-837dfb146add9ab6htuw.img" returned: 1 in 0.339s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c2c4990d-9288-4565-9155-4f4e07dd6665 tempest-VolumesActionsTest-1940405618 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8636e464-b450-4e00-96af-1b889fb9d3d0.temp_image.724fec01-e9a7-460e-82cb-837dfb146add9ab6htuw.img' failed. Not Retrying. {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 19:49:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c2c4990d-9288-4565-9155-4f4e07dd6665 tempest-VolumesActionsTest-1940405618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8636e464-b450-4e00-96af-1b889fb9d3d0.temp_image.724fec01-e9a7-460e-82cb-837dfb146add9ab6htuw.img /opt/stack/data/cinder/conversion/vol_upload_xivnrfdg {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:18 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8636e464-b450-4e00-96af-1b889fb9d3d0.temp_image.724fec01-e9a7-460e-82cb-837dfb146add9ab6htuw.img /opt/stack/data/cinder/conversion/vol_upload_xivnrfdg Jul 17 19:49:18 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:19 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c2c4990d-9288-4565-9155-4f4e07dd6665 tempest-VolumesActionsTest-1940405618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8636e464-b450-4e00-96af-1b889fb9d3d0.temp_image.724fec01-e9a7-460e-82cb-837dfb146add9ab6htuw.img /opt/stack/data/cinder/conversion/vol_upload_xivnrfdg" returned: 0 in 0.284s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:19 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-c2c4990d-9288-4565-9155-4f4e07dd6665 tempest-VolumesActionsTest-1940405618 None] Image conversion details: src /opt/stack/data/cinder/conversion/8636e464-b450-4e00-96af-1b889fb9d3d0.temp_image.724fec01-e9a7-460e-82cb-837dfb146add9ab6htuw.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_xivnrfdg {{(pid=87726) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 19:49:19 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-c2c4990d-9288-4565-9155-4f4e07dd6665 tempest-VolumesActionsTest-1940405618 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 17 19:49:19 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41a28cb-ec58-4b19-8f5d-440d09d2cb05]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:49:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c2c4990d-9288-4565-9155-4f4e07dd6665 tempest-VolumesActionsTest-1940405618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_xivnrfdg {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:19 devstack sudo[100692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_xivnrfdg Jul 17 19:49:19 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:19 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c2c4990d-9288-4565-9155-4f4e07dd6665 tempest-VolumesActionsTest-1940405618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_xivnrfdg" returned: 0 in 0.329s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c2c4990d-9288-4565-9155-4f4e07dd6665 tempest-VolumesActionsTest-1940405618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.122s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:20 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c2c4990d-9288-4565-9155-4f4e07dd6665 tempest-VolumesActionsTest-1940405618 None] Uploaded volume to glance image-id: 724fec01-e9a7-460e-82cb-837dfb146add. {{(pid=87726) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 17 19:49:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-1d41c098-4cc5-4a31-b993-ca195effad3e req-33b6beb5-f69e-4670-86db-ec13e3b96fba tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.228s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-1d41c098-4cc5-4a31-b993-ca195effad3e req-33b6beb5-f69e-4670-86db-ec13e3b96fba tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:20 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-c2c4990d-9288-4565-9155-4f4e07dd6665 tempest-VolumesActionsTest-1940405618 None] Copy volume to image completed successfully. Jul 17 19:49:20 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-1d41c098-4cc5-4a31-b993-ca195effad3e req-33b6beb5-f69e-4670-86db-ec13e3b96fba tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55', 'name': 'volume-5bf34482-c7f9-457d-beec-9616b8996ff4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ce9fc31-2889-4c79-848b-769fa6d6d80e', 'enforce_multipath': True} {{(pid=87726) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 19:49:20 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-84afb8f7-d05b-4fd6-9b36-bd5d01ded213 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Acquiring lock "cinder-d456eff0-f060-4e1d-bbcc-11b64e60aef6-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:49:20 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-84afb8f7-d05b-4fd6-9b36-bd5d01ded213 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Lock "cinder-d456eff0-f060-4e1d-bbcc-11b64e60aef6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:49:20 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-1d41c098-4cc5-4a31-b993-ca195effad3e req-33b6beb5-f69e-4670-86db-ec13e3b96fba tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] attachment_update completed successfully. Jul 17 19:49:21 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-84afb8f7-d05b-4fd6-9b36-bd5d01ded213 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Acquiring lock "cinder-quobyte-d456eff0-f060-4e1d-bbcc-11b64e60aef6" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:49:21 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-84afb8f7-d05b-4fd6-9b36-bd5d01ded213 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Lock "cinder-quobyte-d456eff0-f060-4e1d-bbcc-11b64e60aef6" acquired by "delete_volume" :: waited 0.015s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:49:21 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3152048-b936-4efc-badd-62b95cd80186]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:49:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-84afb8f7-d05b-4fd6-9b36-bd5d01ded213 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d456eff0-f060-4e1d-bbcc-11b64e60aef6 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:21 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d456eff0-f060-4e1d-bbcc-11b64e60aef6 Jul 17 19:49:21 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:21 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-84afb8f7-d05b-4fd6-9b36-bd5d01ded213 tempest-TestServerVolumeAttachmentScenario-1644221099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d456eff0-f060-4e1d-bbcc-11b64e60aef6" returned: 0 in 0.429s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-84afb8f7-d05b-4fd6-9b36-bd5d01ded213 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d456eff0-f060-4e1d-bbcc-11b64e60aef6 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:21 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d456eff0-f060-4e1d-bbcc-11b64e60aef6 Jul 17 19:49:21 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:21 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-84afb8f7-d05b-4fd6-9b36-bd5d01ded213 tempest-TestServerVolumeAttachmentScenario-1644221099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d456eff0-f060-4e1d-bbcc-11b64e60aef6" returned: 0 in 0.323s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:21 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-84afb8f7-d05b-4fd6-9b36-bd5d01ded213 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Lock "cinder-quobyte-d456eff0-f060-4e1d-bbcc-11b64e60aef6" released by "delete_volume" :: held 0.805s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:49:21 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-84afb8f7-d05b-4fd6-9b36-bd5d01ded213 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Created reservations ['0d2ac53c-e0bd-4a2c-8f5f-536f993291e2', 'd3345972-cdc3-4f84-b513-babd575f9887', '08738acd-ee8b-4173-8201-dcc01a653492', 'f0a01698-e551-4bf2-a364-7735aa31df4f'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:49:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-84afb8f7-d05b-4fd6-9b36-bd5d01ded213 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:49:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-84afb8f7-d05b-4fd6-9b36-bd5d01ded213 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-84afb8f7-d05b-4fd6-9b36-bd5d01ded213 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:49:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-84afb8f7-d05b-4fd6-9b36-bd5d01ded213 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:49:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-84afb8f7-d05b-4fd6-9b36-bd5d01ded213 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-84afb8f7-d05b-4fd6-9b36-bd5d01ded213 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:22 devstack sudo[101089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:49:22 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-b5bafd19-3579-45ac-a1c3-3aa4ae2cb7db tempest-VolumesActionsTest-1940405618 None] Acquiring lock "cinder-8636e464-b450-4e00-96af-1b889fb9d3d0-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:49:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-b5bafd19-3579-45ac-a1c3-3aa4ae2cb7db tempest-VolumesActionsTest-1940405618 None] Lock "cinder-8636e464-b450-4e00-96af-1b889fb9d3d0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:49:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-b5bafd19-3579-45ac-a1c3-3aa4ae2cb7db tempest-VolumesActionsTest-1940405618 None] Acquiring lock "cinder-quobyte-8636e464-b450-4e00-96af-1b889fb9d3d0" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:49:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d6d573a1-9d8e-4eae-b19f-381a98957c34 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Acquiring lock "cinder-98533999-6ce0-42da-8dd3-d57abf58cbe6-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:49:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-b5bafd19-3579-45ac-a1c3-3aa4ae2cb7db tempest-VolumesActionsTest-1940405618 None] Lock "cinder-quobyte-8636e464-b450-4e00-96af-1b889fb9d3d0" acquired by "delete_volume" :: waited 0.026s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:49:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d6d573a1-9d8e-4eae-b19f-381a98957c34 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Lock "cinder-98533999-6ce0-42da-8dd3-d57abf58cbe6-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:49:22 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1a13ae-4a02-4e50-94db-95b00b42b0b5]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:49:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b5bafd19-3579-45ac-a1c3-3aa4ae2cb7db tempest-VolumesActionsTest-1940405618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d6d573a1-9d8e-4eae-b19f-381a98957c34 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Acquiring lock "cinder-quobyte-98533999-6ce0-42da-8dd3-d57abf58cbe6" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:49:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d6d573a1-9d8e-4eae-b19f-381a98957c34 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Lock "cinder-quobyte-98533999-6ce0-42da-8dd3-d57abf58cbe6" acquired by "delete_volume" :: waited 0.015s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:49:22 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-84afb8f7-d05b-4fd6-9b36-bd5d01ded213 tempest-TestServerVolumeAttachmentScenario-1644221099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.284s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:22 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-84afb8f7-d05b-4fd6-9b36-bd5d01ded213 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:49:22 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-84afb8f7-d05b-4fd6-9b36-bd5d01ded213 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Deleted volume successfully. Jul 17 19:49:22 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[59240e79-f655-4a54-b91c-d86603797cb6]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:49:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d6d573a1-9d8e-4eae-b19f-381a98957c34 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98533999-6ce0-42da-8dd3-d57abf58cbe6 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-84afb8f7-d05b-4fd6-9b36-bd5d01ded213 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Lock "cinder-d456eff0-f060-4e1d-bbcc-11b64e60aef6-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:49:22 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0 Jul 17 19:49:22 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:22 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98533999-6ce0-42da-8dd3-d57abf58cbe6 Jul 17 19:49:22 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:22 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b5bafd19-3579-45ac-a1c3-3aa4ae2cb7db tempest-VolumesActionsTest-1940405618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0" returned: 0 in 0.396s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b5bafd19-3579-45ac-a1c3-3aa4ae2cb7db tempest-VolumesActionsTest-1940405618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:22 devstack sudo[101101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0 Jul 17 19:49:22 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:22 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d6d573a1-9d8e-4eae-b19f-381a98957c34 tempest-TestServerVolumeAttachmentScenario-1644221099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98533999-6ce0-42da-8dd3-d57abf58cbe6" returned: 0 in 0.372s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d6d573a1-9d8e-4eae-b19f-381a98957c34 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98533999-6ce0-42da-8dd3-d57abf58cbe6 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:22 devstack sudo[101104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98533999-6ce0-42da-8dd3-d57abf58cbe6 Jul 17 19:49:22 devstack sudo[101104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:22 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b5bafd19-3579-45ac-a1c3-3aa4ae2cb7db tempest-VolumesActionsTest-1940405618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8636e464-b450-4e00-96af-1b889fb9d3d0" returned: 0 in 0.254s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-b5bafd19-3579-45ac-a1c3-3aa4ae2cb7db tempest-VolumesActionsTest-1940405618 None] Lock "cinder-quobyte-8636e464-b450-4e00-96af-1b889fb9d3d0" released by "delete_volume" :: held 0.700s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:49:22 devstack sudo[101104]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d6d573a1-9d8e-4eae-b19f-381a98957c34 tempest-TestServerVolumeAttachmentScenario-1644221099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98533999-6ce0-42da-8dd3-d57abf58cbe6" returned: 0 in 0.241s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d6d573a1-9d8e-4eae-b19f-381a98957c34 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Lock "cinder-quobyte-98533999-6ce0-42da-8dd3-d57abf58cbe6" released by "delete_volume" :: held 0.667s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:49:22 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-b5bafd19-3579-45ac-a1c3-3aa4ae2cb7db tempest-VolumesActionsTest-1940405618 None] Created reservations ['acf68a38-aca1-41bd-ab90-01680cb2e0d3', '0f5f4762-f911-4adc-b0b5-95d6c31e0c5b', '5f0ccf0c-3107-4d89-a134-b0059a1228a6', '7e393567-47ec-44fc-b4e1-b8cd6ac9d885'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:49:22 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-d6d573a1-9d8e-4eae-b19f-381a98957c34 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Created reservations ['34e2ab4b-d3d4-4482-a51f-31b545e411d5', '88be55c0-ef04-4fb1-aad4-9feea4188bad', 'fe8859c0-2cf7-46da-977a-d0bfde36f911', '62dded18-a595-4a80-8041-8ab3a194111b'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:49:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b5bafd19-3579-45ac-a1c3-3aa4ae2cb7db tempest-VolumesActionsTest-1940405618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:49:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b5bafd19-3579-45ac-a1c3-3aa4ae2cb7db tempest-VolumesActionsTest-1940405618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b5bafd19-3579-45ac-a1c3-3aa4ae2cb7db tempest-VolumesActionsTest-1940405618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:49:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b5bafd19-3579-45ac-a1c3-3aa4ae2cb7db tempest-VolumesActionsTest-1940405618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:49:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b5bafd19-3579-45ac-a1c3-3aa4ae2cb7db tempest-VolumesActionsTest-1940405618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b5bafd19-3579-45ac-a1c3-3aa4ae2cb7db tempest-VolumesActionsTest-1940405618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:23 devstack sudo[101108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:49:23 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d6d573a1-9d8e-4eae-b19f-381a98957c34 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:49:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d6d573a1-9d8e-4eae-b19f-381a98957c34 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d6d573a1-9d8e-4eae-b19f-381a98957c34 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:49:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d6d573a1-9d8e-4eae-b19f-381a98957c34 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:49:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d6d573a1-9d8e-4eae-b19f-381a98957c34 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d6d573a1-9d8e-4eae-b19f-381a98957c34 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:23 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:49:23 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:23 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b5bafd19-3579-45ac-a1c3-3aa4ae2cb7db tempest-VolumesActionsTest-1940405618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.316s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:23 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-b5bafd19-3579-45ac-a1c3-3aa4ae2cb7db tempest-VolumesActionsTest-1940405618 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:49:23 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-b5bafd19-3579-45ac-a1c3-3aa4ae2cb7db tempest-VolumesActionsTest-1940405618 None] Deleted volume successfully. Jul 17 19:49:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-b5bafd19-3579-45ac-a1c3-3aa4ae2cb7db tempest-VolumesActionsTest-1940405618 None] Lock "cinder-8636e464-b450-4e00-96af-1b889fb9d3d0-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:49:23 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d6d573a1-9d8e-4eae-b19f-381a98957c34 tempest-TestServerVolumeAttachmentScenario-1644221099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.355s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:23 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-d6d573a1-9d8e-4eae-b19f-381a98957c34 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:49:23 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-d6d573a1-9d8e-4eae-b19f-381a98957c34 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Deleted volume successfully. Jul 17 19:49:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d6d573a1-9d8e-4eae-b19f-381a98957c34 tempest-TestServerVolumeAttachmentScenario-1644221099 None] Lock "cinder-98533999-6ce0-42da-8dd3-d57abf58cbe6-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:49:24 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-a68d1ddb-9aec-45c4-a2c4-eddd9c6695ca req-234db1f9-30f1-452a-8b6b-b48515525810 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Terminate volume connection completed successfully. Jul 17 19:49:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-a68d1ddb-9aec-45c4-a2c4-eddd9c6695ca req-234db1f9-30f1-452a-8b6b-b48515525810 tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Deleting attachment 7ce9fc31-2889-4c79-848b-769fa6d6d80e. {{(pid=87726) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 19:49:25 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e3c7bc3b-a45a-46b9-afb8-58b1ad3e2e6d tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Acquiring lock "cinder-5bf34482-c7f9-457d-beec-9616b8996ff4-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:49:25 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e3c7bc3b-a45a-46b9-afb8-58b1ad3e2e6d tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Lock "cinder-5bf34482-c7f9-457d-beec-9616b8996ff4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:49:25 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e3c7bc3b-a45a-46b9-afb8-58b1ad3e2e6d tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Acquiring lock "cinder-quobyte-5bf34482-c7f9-457d-beec-9616b8996ff4" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:49:25 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e3c7bc3b-a45a-46b9-afb8-58b1ad3e2e6d tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Lock "cinder-quobyte-5bf34482-c7f9-457d-beec-9616b8996ff4" acquired by "delete_volume" :: waited 0.017s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:49:25 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[562a79c1-50cc-4f16-ba18-37a72c5da1c4]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:49:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3c7bc3b-a45a-46b9-afb8-58b1ad3e2e6d tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5bf34482-c7f9-457d-beec-9616b8996ff4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:25 devstack sudo[101143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5bf34482-c7f9-457d-beec-9616b8996ff4 Jul 17 19:49:25 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:25 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3c7bc3b-a45a-46b9-afb8-58b1ad3e2e6d tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5bf34482-c7f9-457d-beec-9616b8996ff4" returned: 0 in 0.387s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3c7bc3b-a45a-46b9-afb8-58b1ad3e2e6d tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5bf34482-c7f9-457d-beec-9616b8996ff4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:25 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5bf34482-c7f9-457d-beec-9616b8996ff4 Jul 17 19:49:25 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:25 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3c7bc3b-a45a-46b9-afb8-58b1ad3e2e6d tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5bf34482-c7f9-457d-beec-9616b8996ff4" returned: 0 in 0.263s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:25 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e3c7bc3b-a45a-46b9-afb8-58b1ad3e2e6d tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Lock "cinder-quobyte-5bf34482-c7f9-457d-beec-9616b8996ff4" released by "delete_volume" :: held 0.696s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:49:25 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-e3c7bc3b-a45a-46b9-afb8-58b1ad3e2e6d tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Created reservations ['21151e2a-982d-4b8c-9916-3b5117bcf8d0', '741b9dc8-65c1-4ecd-899c-b9bed0d505c1', '8e08cfc7-1756-4f0c-8571-8b11fa0fa2be', '689631ab-995e-43ba-9788-bc3b7a8c557b'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:49:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e3c7bc3b-a45a-46b9-afb8-58b1ad3e2e6d tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:49:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e3c7bc3b-a45a-46b9-afb8-58b1ad3e2e6d tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e3c7bc3b-a45a-46b9-afb8-58b1ad3e2e6d tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:49:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e3c7bc3b-a45a-46b9-afb8-58b1ad3e2e6d tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:49:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e3c7bc3b-a45a-46b9-afb8-58b1ad3e2e6d tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3c7bc3b-a45a-46b9-afb8-58b1ad3e2e6d tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:26 devstack sudo[101151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:49:26 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:26 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3c7bc3b-a45a-46b9-afb8-58b1ad3e2e6d tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.297s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:26 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-e3c7bc3b-a45a-46b9-afb8-58b1ad3e2e6d tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:49:26 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e3c7bc3b-a45a-46b9-afb8-58b1ad3e2e6d tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Deleted volume successfully. Jul 17 19:49:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e3c7bc3b-a45a-46b9-afb8-58b1ad3e2e6d tempest-TestServerVolumeAttachScenarioOldVersion-769139833 None] Lock "cinder-5bf34482-c7f9-457d-beec-9616b8996ff4-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:49:31 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:49:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] Flow 'volume_create_manager' (7bb841b0-8c61-47b8-8d69-15c7b8046012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:49:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13229147-5198-48dd-aefa-c32cfbaaf55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13229147-5198-48dd-aefa-c32cfbaaf55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-268772740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75efb586-6dd3-42ca-9859-20bb7213209b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc8727d2e6448de92b94e441c49a233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:49:32Z,use_quota=True,user_id='107ed26dcd5147219a0dcfc5cd0ab7ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2ceb293-d4c3-4559-88aa-4a85726372f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2ceb293-d4c3-4559-88aa-4a85726372f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec3ab4a0-48c5-4c35-bf93-d9cc1c2c59be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec3ab4a0-48c5-4c35-bf93-d9cc1c2c59be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75efb586-6dd3-42ca-9859-20bb7213209b', 'volume_name': 'volume-75efb586-6dd3-42ca-9859-20bb7213209b', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (889d0dff-b66d-410f-8513-41642292edf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (889d0dff-b66d-410f-8513-41642292edf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c5681e3-a73a-41a8-a417-0e60111fe521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:31 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] Volume 75efb586-6dd3-42ca-9859-20bb7213209b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75efb586-6dd3-42ca-9859-20bb7213209b', 'volume_size': 1} Jul 17 19:49:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:49:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-268772740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75efb586-6dd3-42ca-9859-20bb7213209b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc8727d2e6448de92b94e441c49a233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:49:32Z,use_quota=True,user_id='107ed26dcd5147219a0dcfc5cd0ab7ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:49:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] Creating volume 75efb586-6dd3-42ca-9859-20bb7213209b {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:49:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:49:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:49:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:49:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:49:31 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:49:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:31 devstack sudo[101181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b 1073741824 Jul 17 19:49:31 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:32 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b 1073741824" returned: 0 in 0.555s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:32 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b Jul 17 19:49:32 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:32 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b" returned: 0 in 0.297s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:32 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:49:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c5681e3-a73a-41a8-a417-0e60111fe521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75efb586-6dd3-42ca-9859-20bb7213209b', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a85a791-685d-4798-94e6-9ebc3ed1fcfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:32 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] Volume volume-75efb586-6dd3-42ca-9859-20bb7213209b (75efb586-6dd3-42ca-9859-20bb7213209b): created successfully Jul 17 19:49:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a85a791-685d-4798-94e6-9ebc3ed1fcfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] Flow 'volume_create_manager' (7bb841b0-8c61-47b8-8d69-15c7b8046012) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:49:32 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-dfebd942-85a7-4f95-a8ee-1fcf6c4e8745 tempest-VolumesCloneTest-569281656 None] Created volume successfully. Jul 17 19:49:34 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:49:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Flow 'volume_create_manager' (01de2323-7529-4a5c-bdf3-c4599b136e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:49:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5930ad1c-3b2e-40ed-b499-9c125cbe8ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5930ad1c-3b2e-40ed-b499-9c125cbe8ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1583446237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc8727d2e6448de92b94e441c49a233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:49:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=75efb586-6dd3-42ca-9859-20bb7213209b,status='creating',terminated_at=None,updated_at=2026-07-17T17:49:35Z,use_quota=True,user_id='107ed26dcd5147219a0dcfc5cd0ab7ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8cc6aba-8b25-4635-a921-8ce6671e5700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8cc6aba-8b25-4635-a921-8ce6671e5700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c16e93c8-3e97-4c03-abb8-040fc6e77b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c16e93c8-3e97-4c03-abb8-040fc6e77b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2', 'volume_name': 'volume-f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2', 'volume_size': 2, 'source_volid': '75efb586-6dd3-42ca-9859-20bb7213209b', 'source_volstatus': 'available'}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1181ac0-f80b-4a5e-b4e0-05d27cb1b4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1181ac0-f80b-4a5e-b4e0-05d27cb1b4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006b8c01-bf7e-462d-bfa8-e62a07583378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:34 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Volume f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2', 'volume_size': 2, 'source_volid': '75efb586-6dd3-42ca-9859-20bb7213209b', 'source_volstatus': 'available'} Jul 17 19:49:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:49:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:34 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Cloning volume 75efb586-6dd3-42ca-9859-20bb7213209b to volume f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2 Jul 17 19:49:34 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Creating offline snapshot 58a69cd4-b134-479c-a223-52d2631324ed of volume 75efb586-6dd3-42ca-9859-20bb7213209b {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:49:34 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ac681c-3f7a-4c46-ab67-8e832b537793]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:49:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:34 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b Jul 17 19:49:34 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:35 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b" returned: 0 in 0.433s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b.58a69cd4-b134-479c-a223-52d2631324ed 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:35 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b.58a69cd4-b134-479c-a223-52d2631324ed 1G Jul 17 19:49:35 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:35 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b.58a69cd4-b134-479c-a223-52d2631324ed 1G" returned: 0 in 0.564s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75efb586-6dd3-42ca-9859-20bb7213209b -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b.58a69cd4-b134-479c-a223-52d2631324ed {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:35 devstack sudo[101205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75efb586-6dd3-42ca-9859-20bb7213209b -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b.58a69cd4-b134-479c-a223-52d2631324ed Jul 17 19:49:35 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:36 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75efb586-6dd3-42ca-9859-20bb7213209b -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b.58a69cd4-b134-479c-a223-52d2631324ed" returned: 0 in 0.319s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:36 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b.58a69cd4-b134-479c-a223-52d2631324ed is being set with open permissions: ugo+rw Jul 17 19:49:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b.58a69cd4-b134-479c-a223-52d2631324ed {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:36 devstack sudo[101210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b.58a69cd4-b134-479c-a223-52d2631324ed Jul 17 19:49:36 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:36 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b.58a69cd4-b134-479c-a223-52d2631324ed" returned: 0 in 0.282s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:36 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b.info Jul 17 19:49:36 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:36 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b.info" returned: 0 in 0.324s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:36 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b.info is being set with open permissions: ugo+rw Jul 17 19:49:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:36 devstack sudo[101216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b.info Jul 17 19:49:36 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:36 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:49:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] Flow 'volume_create_manager' (1a76cadd-eb97-464d-a6fb-b9f80ef7a0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:49:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (676e2c12-4051-462f-8508-ff833a491230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (676e2c12-4051-462f-8508-ff833a491230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1149384135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb34ada-ec5d-4b38-99be-2645de9f8900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da34bae55afb48438d374943b6850f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:49:37Z,use_quota=True,user_id='cdd9d6d1eecd46939266e29f3abfee79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (536e08dd-25f9-444d-ab93-53983ecc965c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (536e08dd-25f9-444d-ab93-53983ecc965c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c0eb8b-8bbc-46bc-9d93-67e8a027ab00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c0eb8b-8bbc-46bc-9d93-67e8a027ab00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccb34ada-ec5d-4b38-99be-2645de9f8900', 'volume_name': 'volume-ccb34ada-ec5d-4b38-99be-2645de9f8900', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e6b9481-2804-4e28-92ab-9046a61aab33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:37 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e6b9481-2804-4e28-92ab-9046a61aab33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c16082ab-8357-4615-a1b6-660ba634a5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:37 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] Volume ccb34ada-ec5d-4b38-99be-2645de9f8900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccb34ada-ec5d-4b38-99be-2645de9f8900', 'volume_size': 1} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b.info" returned: 0 in 0.359s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Acquiring lock "cinder-quobyte-f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2" by "_copy_volume_from_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Lock "cinder-quobyte-f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] snapshot: 58a69cd4-b134-479c-a223-52d2631324ed, volume: f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2, {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9096ad5-a5a4-478a-b270-e68bcf8fcbdb]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b.58a69cd4-b134-479c-a223-52d2631324ed {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:37 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b.58a69cd4-b134-479c-a223-52d2631324ed Jul 17 19:49:37 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] Flow 'volume_create_manager' (c90dfc82-7633-4b0c-bc90-c63b7567a755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144e7461-9e93-4cb7-a947-880a696cd433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144e7461-9e93-4cb7-a947-880a696cd433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1784142001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=204d238d-8a91-4481-97d9-bb7cb88776da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da34bae55afb48438d374943b6850f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:49:37Z,use_quota=True,user_id='cdd9d6d1eecd46939266e29f3abfee79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0cee6c0-bccd-4d63-a2e3-7c609c03f606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0cee6c0-bccd-4d63-a2e3-7c609c03f606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (868a23c4-1d72-42c4-9fd3-5e828a538a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (868a23c4-1d72-42c4-9fd3-5e828a538a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '204d238d-8a91-4481-97d9-bb7cb88776da', 'volume_name': 'volume-204d238d-8a91-4481-97d9-bb7cb88776da', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d10f3f88-d09e-4d77-8b7f-54843d188746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d10f3f88-d09e-4d77-8b7f-54843d188746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5140c695-3986-4429-b22c-9de3f61bb23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:37 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] Volume 204d238d-8a91-4481-97d9-bb7cb88776da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-204d238d-8a91-4481-97d9-bb7cb88776da', 'volume_size': 1} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:49:37 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b.58a69cd4-b134-479c-a223-52d2631324ed" returned: 0 in 0.520s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75efb586-6dd3-42ca-9859-20bb7213209b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Creating direct copy from snapshot {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e4f7ba-e719-47d4-82e9-e764cf54575f]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] Flow 'volume_create_manager' (f55950b9-4061-4f0d-b199-76ac8f434ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0202a6c2-0ea7-41b0-b801-79f3ed41e39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0202a6c2-0ea7-41b0-b801-79f3ed41e39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-271862511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3910335d-4152-4575-a7da-fc73319b4cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da34bae55afb48438d374943b6850f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:49:38Z,use_quota=True,user_id='cdd9d6d1eecd46939266e29f3abfee79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b042b475-c040-4941-823f-03208d498855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b042b475-c040-4941-823f-03208d498855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff32f92d-61d3-46b1-8b53-039162833a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff32f92d-61d3-46b1-8b53-039162833a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3910335d-4152-4575-a7da-fc73319b4cc6', 'volume_name': 'volume-3910335d-4152-4575-a7da-fc73319b4cc6', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ff8c5c7-2b7d-46c3-a76e-c2193c099d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ff8c5c7-2b7d-46c3-a76e-c2193c099d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8152221f-f2f0-48ca-8e33-6d749d82a3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:37 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b Jul 17 19:49:37 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:37 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] Volume 3910335d-4152-4575-a7da-fc73319b4cc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3910335d-4152-4575-a7da-fc73319b4cc6', 'volume_size': 1} Jul 17 19:49:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:49:38 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:49:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] Flow 'volume_create_manager' (fd5a28ec-8ada-41e2-82b0-88e004e7e098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:49:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05a6d2f9-d521-4a8d-aada-05ec9f8fce69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05a6d2f9-d521-4a8d-aada-05ec9f8fce69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2024705637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a71ef73-a95e-4b1d-9298-99f5a3382f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da34bae55afb48438d374943b6850f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:49:38Z,use_quota=True,user_id='cdd9d6d1eecd46939266e29f3abfee79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (260cce2c-4f2c-4220-adce-590ebfea11af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (260cce2c-4f2c-4220-adce-590ebfea11af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f13b9b-ddc2-4b7f-995a-030cfdc27393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f13b9b-ddc2-4b7f-995a-030cfdc27393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a71ef73-a95e-4b1d-9298-99f5a3382f78', 'volume_name': 'volume-3a71ef73-a95e-4b1d-9298-99f5a3382f78', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4c58d4-d627-4117-ba5d-c448fec37c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4c58d4-d627-4117-ba5d-c448fec37c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae538654-dd91-484a-9781-9eaef5600cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:38 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] Volume 3a71ef73-a95e-4b1d-9298-99f5a3382f78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a71ef73-a95e-4b1d-9298-99f5a3382f78', 'volume_size': 1} Jul 17 19:49:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:49:38 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b" returned: 0 in 0.538s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:38 devstack cinder-volume[87726]: DEBUG cinder.utils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Path /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2 not found in is_blk_device check {{(pid=87726) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 19:49:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:38 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2 Jul 17 19:49:38 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:38 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:49:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] Flow 'volume_create_manager' (c7eb4006-9fc2-4f45-af5e-1d8cd71e94e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:49:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b02e1e09-a6c5-476e-92e5-d20dd450420d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b02e1e09-a6c5-476e-92e5-d20dd450420d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-330959670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=182232ce-3115-4ce9-a4f3-b754ac505c66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da34bae55afb48438d374943b6850f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:49:39Z,use_quota=True,user_id='cdd9d6d1eecd46939266e29f3abfee79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f01ca5a-5cb4-496b-8da8-e68d7c05ebdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f01ca5a-5cb4-496b-8da8-e68d7c05ebdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e2d7bfb-909c-4622-8c66-9b53e5afa733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e2d7bfb-909c-4622-8c66-9b53e5afa733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '182232ce-3115-4ce9-a4f3-b754ac505c66', 'volume_name': 'volume-182232ce-3115-4ce9-a4f3-b754ac505c66', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e0ecf5-e7d9-4a97-8579-8ae54a0d0637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e0ecf5-e7d9-4a97-8579-8ae54a0d0637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce65ef3-5d32-48bf-8ef7-6ddcb764afec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:38 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] Volume 182232ce-3115-4ce9-a4f3-b754ac505c66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-182232ce-3115-4ce9-a4f3-b754ac505c66', 'volume_size': 1} Jul 17 19:49:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:49:43 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2" returned: 0 in 4.869s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:43 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad878174-cfc2-4db4-8e2b-62d747f6d6be]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:49:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:43 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b Jul 17 19:49:43 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:43 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b" returned: 0 in 0.577s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:43 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Image conversion details: src /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b, size 1024.00 MB, duration 4.87 sec, destination /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2 {{(pid=87726) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 19:49:43 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Converted 1024.00 MB image at 210.25 MB/s Jul 17 19:49:43 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2 is being set with open permissions: ugo+rw Jul 17 19:49:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:43 devstack sudo[101251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2 Jul 17 19:49:43 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:44 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2" returned: 0 in 0.276s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:44 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Lock "cinder-quobyte-f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2" released by "_copy_volume_from_snapshot" :: held 6.875s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:49:44 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Acquiring lock "cinder-quobyte-58a69cd4-b134-479c-a223-52d2631324ed" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:49:44 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Lock "cinder-quobyte-58a69cd4-b134-479c-a223-52d2631324ed" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:49:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Deleting offline snapshot 58a69cd4-b134-479c-a223-52d2631324ed of volume 75efb586-6dd3-42ca-9859-20bb7213209b {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:49:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] snapshot_file for this snap is: volume-75efb586-6dd3-42ca-9859-20bb7213209b.58a69cd4-b134-479c-a223-52d2631324ed {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:49:44 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1d3c68-00bf-4f60-86f0-4f7ba083a376]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:49:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b.58a69cd4-b134-479c-a223-52d2631324ed {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:44 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b.58a69cd4-b134-479c-a223-52d2631324ed Jul 17 19:49:44 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:44 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b.58a69cd4-b134-479c-a223-52d2631324ed" returned: 0 in 0.385s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75efb586-6dd3-42ca-9859-20bb7213209b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:49:44 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c8aece-d9b0-46f9-a90f-cc0bb995a3f0]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:49:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:44 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b Jul 17 19:49:44 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:44 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b" returned: 0 in 0.371s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b.58a69cd4-b134-479c-a223-52d2631324ed {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:44 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b.58a69cd4-b134-479c-a223-52d2631324ed Jul 17 19:49:44 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:45 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b.58a69cd4-b134-479c-a223-52d2631324ed" returned: 0 in 0.337s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b.58a69cd4-b134-479c-a223-52d2631324ed {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:45 devstack sudo[101269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b.58a69cd4-b134-479c-a223-52d2631324ed Jul 17 19:49:45 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:45 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b.58a69cd4-b134-479c-a223-52d2631324ed" returned: 0 in 0.282s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:45 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Lock "cinder-quobyte-58a69cd4-b134-479c-a223-52d2631324ed" released by "_delete_snapshot" :: held 1.469s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:49:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.843s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.475s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:45 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1149384135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb34ada-ec5d-4b38-99be-2645de9f8900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da34bae55afb48438d374943b6850f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:49:37Z,use_quota=True,user_id='cdd9d6d1eecd46939266e29f3abfee79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:49:45 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] Creating volume ccb34ada-ec5d-4b38-99be-2645de9f8900 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:49:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:49:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:45 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:49:45 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:49:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:45 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:49:45 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:49:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ccb34ada-ec5d-4b38-99be-2645de9f8900 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:45 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ccb34ada-ec5d-4b38-99be-2645de9f8900 1073741824 Jul 17 19:49:45 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006b8c01-bf7e-462d-bfa8-e62a07583378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2', 'volume_size': 2, 'source_volid': '75efb586-6dd3-42ca-9859-20bb7213209b', 'source_volstatus': 'available'}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf2a629-79e1-4916-981b-f881897e2738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:45 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Volume volume-f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2 (f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2): created successfully Jul 17 19:49:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf2a629-79e1-4916-981b-f881897e2738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Flow 'volume_create_manager' (01de2323-7529-4a5c-bdf3-c4599b136e95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:49:45 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-271b9bb4-f02c-42be-8e54-4e7185490491 tempest-VolumesCloneTest-569281656 None] Created volume successfully. Jul 17 19:49:46 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ccb34ada-ec5d-4b38-99be-2645de9f8900 1073741824" returned: 0 in 0.450s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ccb34ada-ec5d-4b38-99be-2645de9f8900 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:46 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ccb34ada-ec5d-4b38-99be-2645de9f8900 Jul 17 19:49:46 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:46 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ccb34ada-ec5d-4b38-99be-2645de9f8900" returned: 0 in 0.287s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:46 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:49:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.878s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:46 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1784142001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=204d238d-8a91-4481-97d9-bb7cb88776da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da34bae55afb48438d374943b6850f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:49:37Z,use_quota=True,user_id='cdd9d6d1eecd46939266e29f3abfee79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:49:46 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] Creating volume 204d238d-8a91-4481-97d9-bb7cb88776da {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:49:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:49:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:46 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:49:46 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:49:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:46 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:49:46 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:49:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-204d238d-8a91-4481-97d9-bb7cb88776da 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c16082ab-8357-4615-a1b6-660ba634a5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccb34ada-ec5d-4b38-99be-2645de9f8900', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:46 devstack sudo[101280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-204d238d-8a91-4481-97d9-bb7cb88776da 1073741824 Jul 17 19:49:46 devstack sudo[101280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01f3ce32-9c27-456a-a0e6-154182d9c8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:46 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] Volume volume-ccb34ada-ec5d-4b38-99be-2645de9f8900 (ccb34ada-ec5d-4b38-99be-2645de9f8900): created successfully Jul 17 19:49:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01f3ce32-9c27-456a-a0e6-154182d9c8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] Flow 'volume_create_manager' (1a76cadd-eb97-464d-a6fb-b9f80ef7a0d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:49:46 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-94d85ed3-3a8d-4ed1-90da-19119b6ce27f tempest-CreateVolumesFromImageTest-531355877 None] Created volume successfully. Jul 17 19:49:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e6f14036-e54d-48e9-9cd3-eaca7e171fe4 tempest-VolumesCloneTest-569281656 None] Acquiring lock "cinder-f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:49:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e6f14036-e54d-48e9-9cd3-eaca7e171fe4 tempest-VolumesCloneTest-569281656 None] Lock "cinder-f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:49:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e6f14036-e54d-48e9-9cd3-eaca7e171fe4 tempest-VolumesCloneTest-569281656 None] Acquiring lock "cinder-quobyte-f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:49:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e6f14036-e54d-48e9-9cd3-eaca7e171fe4 tempest-VolumesCloneTest-569281656 None] Lock "cinder-quobyte-f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2" acquired by "delete_volume" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:49:46 devstack sudo[101280]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-204d238d-8a91-4481-97d9-bb7cb88776da 1073741824" returned: 0 in 0.560s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:46 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf87e8f1-6420-4d13-8f0c-42dfdc4fb5f4]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:49:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e6f14036-e54d-48e9-9cd3-eaca7e171fe4 tempest-VolumesCloneTest-569281656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-204d238d-8a91-4481-97d9-bb7cb88776da {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:47 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-204d238d-8a91-4481-97d9-bb7cb88776da Jul 17 19:49:47 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:47 devstack sudo[101286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2 Jul 17 19:49:47 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:47 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-204d238d-8a91-4481-97d9-bb7cb88776da" returned: 0 in 0.320s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.423s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-271862511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3910335d-4152-4575-a7da-fc73319b4cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da34bae55afb48438d374943b6850f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:49:38Z,use_quota=True,user_id='cdd9d6d1eecd46939266e29f3abfee79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] Creating volume 3910335d-4152-4575-a7da-fc73319b4cc6 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:49:47 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3910335d-4152-4575-a7da-fc73319b4cc6 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5140c695-3986-4429-b22c-9de3f61bb23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-204d238d-8a91-4481-97d9-bb7cb88776da', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b90b64-8888-4cb5-8f49-2e2646571147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:47 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e6f14036-e54d-48e9-9cd3-eaca7e171fe4 tempest-VolumesCloneTest-569281656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2" returned: 0 in 0.413s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e6f14036-e54d-48e9-9cd3-eaca7e171fe4 tempest-VolumesCloneTest-569281656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:47 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3910335d-4152-4575-a7da-fc73319b4cc6 1073741824 Jul 17 19:49:47 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:47 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] Volume volume-204d238d-8a91-4481-97d9-bb7cb88776da (204d238d-8a91-4481-97d9-bb7cb88776da): created successfully Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b90b64-8888-4cb5-8f49-2e2646571147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] Flow 'volume_create_manager' (c90dfc82-7633-4b0c-bc90-c63b7567a755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:49:47 devstack sudo[101297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2 Jul 17 19:49:47 devstack sudo[101297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:47 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-a24b81d4-9003-46cc-97c8-19ded9987804 tempest-CreateVolumesFromImageTest-531355877 None] Created volume successfully. Jul 17 19:49:47 devstack sudo[101297]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e6f14036-e54d-48e9-9cd3-eaca7e171fe4 tempest-VolumesCloneTest-569281656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2" returned: 0 in 0.286s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e6f14036-e54d-48e9-9cd3-eaca7e171fe4 tempest-VolumesCloneTest-569281656 None] Lock "cinder-quobyte-f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2" released by "delete_volume" :: held 0.744s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-e6f14036-e54d-48e9-9cd3-eaca7e171fe4 tempest-VolumesCloneTest-569281656 None] Created reservations ['2720d869-44a6-4e10-befa-94737304bc65', '34700f4e-8696-44f6-832a-1a069c4fac85', '0970bbcf-60f3-4329-9319-72a4d838dfbb', 'd81e7c31-a38d-4bc7-880e-5cbefbd8ec31'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e6f14036-e54d-48e9-9cd3-eaca7e171fe4 tempest-VolumesCloneTest-569281656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e6f14036-e54d-48e9-9cd3-eaca7e171fe4 tempest-VolumesCloneTest-569281656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e6f14036-e54d-48e9-9cd3-eaca7e171fe4 tempest-VolumesCloneTest-569281656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e6f14036-e54d-48e9-9cd3-eaca7e171fe4 tempest-VolumesCloneTest-569281656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e6f14036-e54d-48e9-9cd3-eaca7e171fe4 tempest-VolumesCloneTest-569281656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e6f14036-e54d-48e9-9cd3-eaca7e171fe4 tempest-VolumesCloneTest-569281656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:47 devstack sudo[101304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:49:47 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:47 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3910335d-4152-4575-a7da-fc73319b4cc6 1073741824" returned: 0 in 0.533s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3910335d-4152-4575-a7da-fc73319b4cc6 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:47 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3910335d-4152-4575-a7da-fc73319b4cc6 Jul 17 19:49:47 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:48 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1aa7a77a-f94f-4445-8709-8627a5da6e21 tempest-VolumesCloneTest-569281656 None] Acquiring lock "cinder-75efb586-6dd3-42ca-9859-20bb7213209b-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:49:48 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e6f14036-e54d-48e9-9cd3-eaca7e171fe4 tempest-VolumesCloneTest-569281656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.288s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:48 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-e6f14036-e54d-48e9-9cd3-eaca7e171fe4 tempest-VolumesCloneTest-569281656 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:49:48 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e6f14036-e54d-48e9-9cd3-eaca7e171fe4 tempest-VolumesCloneTest-569281656 None] Deleted volume successfully. Jul 17 19:49:48 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1aa7a77a-f94f-4445-8709-8627a5da6e21 tempest-VolumesCloneTest-569281656 None] Lock "cinder-75efb586-6dd3-42ca-9859-20bb7213209b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:49:48 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e6f14036-e54d-48e9-9cd3-eaca7e171fe4 tempest-VolumesCloneTest-569281656 None] Lock "cinder-f291e7f4-c9fc-4dc6-ba0d-29d6d779edf2-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:49:48 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1aa7a77a-f94f-4445-8709-8627a5da6e21 tempest-VolumesCloneTest-569281656 None] Acquiring lock "cinder-quobyte-75efb586-6dd3-42ca-9859-20bb7213209b" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:49:48 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1aa7a77a-f94f-4445-8709-8627a5da6e21 tempest-VolumesCloneTest-569281656 None] Lock "cinder-quobyte-75efb586-6dd3-42ca-9859-20bb7213209b" acquired by "delete_volume" :: waited 0.015s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:49:48 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3910335d-4152-4575-a7da-fc73319b4cc6" returned: 0 in 0.334s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:48 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:49:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.004s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:48 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2024705637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a71ef73-a95e-4b1d-9298-99f5a3382f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da34bae55afb48438d374943b6850f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:49:38Z,use_quota=True,user_id='cdd9d6d1eecd46939266e29f3abfee79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:49:48 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] Creating volume 3a71ef73-a95e-4b1d-9298-99f5a3382f78 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:49:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:49:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:48 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:49:48 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:49:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:48 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:49:48 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:49:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3a71ef73-a95e-4b1d-9298-99f5a3382f78 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:48 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c759c3f-573b-48a3-9733-b8ef691e1058]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:49:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1aa7a77a-f94f-4445-8709-8627a5da6e21 tempest-VolumesCloneTest-569281656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:48 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3a71ef73-a95e-4b1d-9298-99f5a3382f78 1073741824 Jul 17 19:49:48 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:48 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8152221f-f2f0-48ca-8e33-6d749d82a3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3910335d-4152-4575-a7da-fc73319b4cc6', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:48 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (939b380c-14ae-4f3d-98eb-a803bf97b512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:48 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] Volume volume-3910335d-4152-4575-a7da-fc73319b4cc6 (3910335d-4152-4575-a7da-fc73319b4cc6): created successfully Jul 17 19:49:48 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (939b380c-14ae-4f3d-98eb-a803bf97b512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:48 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] Flow 'volume_create_manager' (f55950b9-4061-4f0d-b199-76ac8f434ec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:49:48 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-193b3531-eab2-44c8-af81-ff3c8aae0ded tempest-CreateVolumesFromImageTest-531355877 None] Created volume successfully. Jul 17 19:49:48 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b Jul 17 19:49:48 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:48 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1aa7a77a-f94f-4445-8709-8627a5da6e21 tempest-VolumesCloneTest-569281656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b" returned: 0 in 0.493s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1aa7a77a-f94f-4445-8709-8627a5da6e21 tempest-VolumesCloneTest-569281656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:48 devstack sudo[101321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b Jul 17 19:49:48 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:48 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3a71ef73-a95e-4b1d-9298-99f5a3382f78 1073741824" returned: 0 in 0.543s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3a71ef73-a95e-4b1d-9298-99f5a3382f78 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:48 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3a71ef73-a95e-4b1d-9298-99f5a3382f78 Jul 17 19:49:48 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:49 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1aa7a77a-f94f-4445-8709-8627a5da6e21 tempest-VolumesCloneTest-569281656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75efb586-6dd3-42ca-9859-20bb7213209b" returned: 0 in 0.267s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1aa7a77a-f94f-4445-8709-8627a5da6e21 tempest-VolumesCloneTest-569281656 None] Lock "cinder-quobyte-75efb586-6dd3-42ca-9859-20bb7213209b" released by "delete_volume" :: held 0.849s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:49:49 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3a71ef73-a95e-4b1d-9298-99f5a3382f78" returned: 0 in 0.259s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.333s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-330959670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=182232ce-3115-4ce9-a4f3-b754ac505c66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da34bae55afb48438d374943b6850f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:49:39Z,use_quota=True,user_id='cdd9d6d1eecd46939266e29f3abfee79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] Creating volume 182232ce-3115-4ce9-a4f3-b754ac505c66 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:49:49 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-182232ce-3115-4ce9-a4f3-b754ac505c66 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae538654-dd91-484a-9781-9eaef5600cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a71ef73-a95e-4b1d-9298-99f5a3382f78', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:49 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-182232ce-3115-4ce9-a4f3-b754ac505c66 1073741824 Jul 17 19:49:49 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a8ece48-fb4b-429c-b59c-df2a81b983f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-1aa7a77a-f94f-4445-8709-8627a5da6e21 tempest-VolumesCloneTest-569281656 None] Created reservations ['420bd48a-cad9-4096-9a75-9b83632c4313', 'b617f0cc-e005-4572-8ba0-0d604d4c2617', 'fedc8e13-0569-441a-a496-053fb6917ad5', '0a3d3e03-406a-4e2b-b68f-eb83f979ba8d'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:49:49 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] Volume volume-3a71ef73-a95e-4b1d-9298-99f5a3382f78 (3a71ef73-a95e-4b1d-9298-99f5a3382f78): created successfully Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a8ece48-fb4b-429c-b59c-df2a81b983f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] Flow 'volume_create_manager' (fd5a28ec-8ada-41e2-82b0-88e004e7e098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:49:49 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-323aecc1-227f-4d28-aaa1-481947cd15f1 tempest-CreateVolumesFromImageTest-531355877 None] Created volume successfully. Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1aa7a77a-f94f-4445-8709-8627a5da6e21 tempest-VolumesCloneTest-569281656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1aa7a77a-f94f-4445-8709-8627a5da6e21 tempest-VolumesCloneTest-569281656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-1aa7a77a-f94f-4445-8709-8627a5da6e21 tempest-VolumesCloneTest-569281656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-1aa7a77a-f94f-4445-8709-8627a5da6e21 tempest-VolumesCloneTest-569281656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1aa7a77a-f94f-4445-8709-8627a5da6e21 tempest-VolumesCloneTest-569281656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1aa7a77a-f94f-4445-8709-8627a5da6e21 tempest-VolumesCloneTest-569281656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:49 devstack sudo[101329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:49:49 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:49 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1aa7a77a-f94f-4445-8709-8627a5da6e21 tempest-VolumesCloneTest-569281656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.320s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-1aa7a77a-f94f-4445-8709-8627a5da6e21 tempest-VolumesCloneTest-569281656 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:49:49 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-1aa7a77a-f94f-4445-8709-8627a5da6e21 tempest-VolumesCloneTest-569281656 None] Deleted volume successfully. Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1aa7a77a-f94f-4445-8709-8627a5da6e21 tempest-VolumesCloneTest-569281656 None] Lock "cinder-75efb586-6dd3-42ca-9859-20bb7213209b-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:49:49 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-182232ce-3115-4ce9-a4f3-b754ac505c66 1073741824" returned: 0 in 0.744s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-182232ce-3115-4ce9-a4f3-b754ac505c66 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:49 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-182232ce-3115-4ce9-a4f3-b754ac505c66 Jul 17 19:49:49 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:50 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-182232ce-3115-4ce9-a4f3-b754ac505c66" returned: 0 in 0.295s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:50 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:49:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:50 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce65ef3-5d32-48bf-8ef7-6ddcb764afec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-182232ce-3115-4ce9-a4f3-b754ac505c66', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:50 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9da5aea-1cc2-4641-9930-72ed6bfb6f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:49:50 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] Volume volume-182232ce-3115-4ce9-a4f3-b754ac505c66 (182232ce-3115-4ce9-a4f3-b754ac505c66): created successfully Jul 17 19:49:50 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9da5aea-1cc2-4641-9930-72ed6bfb6f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:49:50 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] Flow 'volume_create_manager' (c7eb4006-9fc2-4f45-af5e-1d8cd71e94e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:49:50 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e18b25cf-e409-42e5-8171-3a2b357f2a58 tempest-CreateVolumesFromImageTest-531355877 None] Created volume successfully. Jul 17 19:49:51 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2e70a0c1-b122-41af-96a1-ae18f793c97a tempest-CreateVolumesFromImageTest-531355877 None] Acquiring lock "cinder-182232ce-3115-4ce9-a4f3-b754ac505c66-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:49:51 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2e70a0c1-b122-41af-96a1-ae18f793c97a tempest-CreateVolumesFromImageTest-531355877 None] Lock "cinder-182232ce-3115-4ce9-a4f3-b754ac505c66-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:49:51 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2e70a0c1-b122-41af-96a1-ae18f793c97a tempest-CreateVolumesFromImageTest-531355877 None] Acquiring lock "cinder-quobyte-182232ce-3115-4ce9-a4f3-b754ac505c66" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:49:51 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2e70a0c1-b122-41af-96a1-ae18f793c97a tempest-CreateVolumesFromImageTest-531355877 None] Lock "cinder-quobyte-182232ce-3115-4ce9-a4f3-b754ac505c66" acquired by "delete_volume" :: waited 0.026s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:49:51 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b3b84b-e1d6-4052-bd0c-3de10f607022]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:49:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2e70a0c1-b122-41af-96a1-ae18f793c97a tempest-CreateVolumesFromImageTest-531355877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-182232ce-3115-4ce9-a4f3-b754ac505c66 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:51 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-182232ce-3115-4ce9-a4f3-b754ac505c66 Jul 17 19:49:51 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:51 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2e70a0c1-b122-41af-96a1-ae18f793c97a tempest-CreateVolumesFromImageTest-531355877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-182232ce-3115-4ce9-a4f3-b754ac505c66" returned: 0 in 0.412s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2e70a0c1-b122-41af-96a1-ae18f793c97a tempest-CreateVolumesFromImageTest-531355877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-182232ce-3115-4ce9-a4f3-b754ac505c66 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:51 devstack sudo[101382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-182232ce-3115-4ce9-a4f3-b754ac505c66 Jul 17 19:49:51 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:51 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2e70a0c1-b122-41af-96a1-ae18f793c97a tempest-CreateVolumesFromImageTest-531355877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-182232ce-3115-4ce9-a4f3-b754ac505c66" returned: 0 in 0.264s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:51 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2e70a0c1-b122-41af-96a1-ae18f793c97a tempest-CreateVolumesFromImageTest-531355877 None] Lock "cinder-quobyte-182232ce-3115-4ce9-a4f3-b754ac505c66" released by "delete_volume" :: held 0.743s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:49:51 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-2e70a0c1-b122-41af-96a1-ae18f793c97a tempest-CreateVolumesFromImageTest-531355877 None] Created reservations ['aa9de481-6d98-4d05-a97f-c86a9dbb15ab', '63094668-0c51-495a-960a-a2c325a5f9ad', 'c7d16fdf-8e63-4042-81b3-5d479c4d9d99', '4c570147-7d9c-49f1-8e83-43d263480eb0'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:49:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-2e70a0c1-b122-41af-96a1-ae18f793c97a tempest-CreateVolumesFromImageTest-531355877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:49:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-2e70a0c1-b122-41af-96a1-ae18f793c97a tempest-CreateVolumesFromImageTest-531355877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:52 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-2e70a0c1-b122-41af-96a1-ae18f793c97a tempest-CreateVolumesFromImageTest-531355877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:49:52 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-2e70a0c1-b122-41af-96a1-ae18f793c97a tempest-CreateVolumesFromImageTest-531355877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:49:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-2e70a0c1-b122-41af-96a1-ae18f793c97a tempest-CreateVolumesFromImageTest-531355877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2e70a0c1-b122-41af-96a1-ae18f793c97a tempest-CreateVolumesFromImageTest-531355877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:52 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:49:52 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:52 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7482bfd4-41ef-40a6-b54a-8cab11dd1b76 tempest-CreateVolumesFromImageTest-531355877 None] Acquiring lock "cinder-3a71ef73-a95e-4b1d-9298-99f5a3382f78-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:49:52 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7482bfd4-41ef-40a6-b54a-8cab11dd1b76 tempest-CreateVolumesFromImageTest-531355877 None] Lock "cinder-3a71ef73-a95e-4b1d-9298-99f5a3382f78-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:49:52 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7482bfd4-41ef-40a6-b54a-8cab11dd1b76 tempest-CreateVolumesFromImageTest-531355877 None] Acquiring lock "cinder-quobyte-3a71ef73-a95e-4b1d-9298-99f5a3382f78" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:49:52 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2e70a0c1-b122-41af-96a1-ae18f793c97a tempest-CreateVolumesFromImageTest-531355877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.392s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:52 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-2e70a0c1-b122-41af-96a1-ae18f793c97a tempest-CreateVolumesFromImageTest-531355877 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:49:52 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-2e70a0c1-b122-41af-96a1-ae18f793c97a tempest-CreateVolumesFromImageTest-531355877 None] Deleted volume successfully. Jul 17 19:49:52 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7482bfd4-41ef-40a6-b54a-8cab11dd1b76 tempest-CreateVolumesFromImageTest-531355877 None] Lock "cinder-quobyte-3a71ef73-a95e-4b1d-9298-99f5a3382f78" acquired by "delete_volume" :: waited 0.023s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:49:52 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-2e70a0c1-b122-41af-96a1-ae18f793c97a tempest-CreateVolumesFromImageTest-531355877 None] Lock "cinder-182232ce-3115-4ce9-a4f3-b754ac505c66-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:49:52 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cc3a53-b3a9-4796-9446-f9b75552f7b3]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:49:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7482bfd4-41ef-40a6-b54a-8cab11dd1b76 tempest-CreateVolumesFromImageTest-531355877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3a71ef73-a95e-4b1d-9298-99f5a3382f78 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:52 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3a71ef73-a95e-4b1d-9298-99f5a3382f78 Jul 17 19:49:52 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:52 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7482bfd4-41ef-40a6-b54a-8cab11dd1b76 tempest-CreateVolumesFromImageTest-531355877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3a71ef73-a95e-4b1d-9298-99f5a3382f78" returned: 0 in 0.476s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7482bfd4-41ef-40a6-b54a-8cab11dd1b76 tempest-CreateVolumesFromImageTest-531355877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3a71ef73-a95e-4b1d-9298-99f5a3382f78 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:53 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3a71ef73-a95e-4b1d-9298-99f5a3382f78 Jul 17 19:49:53 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:53 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7482bfd4-41ef-40a6-b54a-8cab11dd1b76 tempest-CreateVolumesFromImageTest-531355877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3a71ef73-a95e-4b1d-9298-99f5a3382f78" returned: 0 in 0.326s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:53 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7482bfd4-41ef-40a6-b54a-8cab11dd1b76 tempest-CreateVolumesFromImageTest-531355877 None] Lock "cinder-quobyte-3a71ef73-a95e-4b1d-9298-99f5a3382f78" released by "delete_volume" :: held 0.873s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:49:53 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-7482bfd4-41ef-40a6-b54a-8cab11dd1b76 tempest-CreateVolumesFromImageTest-531355877 None] Created reservations ['4848f14a-8ab8-48a3-934b-68d1a1a49bc5', '72049ae4-e8f4-4c7a-96aa-d800228aa6ea', 'e6d97cdd-1d0b-4027-adb2-4716f7e0aa84', '1e5d3a4b-9db9-44cb-a80f-af5ac080cd8e'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:49:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7482bfd4-41ef-40a6-b54a-8cab11dd1b76 tempest-CreateVolumesFromImageTest-531355877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:49:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7482bfd4-41ef-40a6-b54a-8cab11dd1b76 tempest-CreateVolumesFromImageTest-531355877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:53 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7482bfd4-41ef-40a6-b54a-8cab11dd1b76 tempest-CreateVolumesFromImageTest-531355877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:49:53 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7482bfd4-41ef-40a6-b54a-8cab11dd1b76 tempest-CreateVolumesFromImageTest-531355877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:49:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7482bfd4-41ef-40a6-b54a-8cab11dd1b76 tempest-CreateVolumesFromImageTest-531355877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7482bfd4-41ef-40a6-b54a-8cab11dd1b76 tempest-CreateVolumesFromImageTest-531355877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:53 devstack sudo[101396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:49:53 devstack sudo[101396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:53 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1b850fe9-8d64-449c-b6c4-e82d877249b7 tempest-CreateVolumesFromImageTest-531355877 None] Acquiring lock "cinder-3910335d-4152-4575-a7da-fc73319b4cc6-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:49:53 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1b850fe9-8d64-449c-b6c4-e82d877249b7 tempest-CreateVolumesFromImageTest-531355877 None] Lock "cinder-3910335d-4152-4575-a7da-fc73319b4cc6-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:49:53 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1b850fe9-8d64-449c-b6c4-e82d877249b7 tempest-CreateVolumesFromImageTest-531355877 None] Acquiring lock "cinder-quobyte-3910335d-4152-4575-a7da-fc73319b4cc6" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:49:53 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1b850fe9-8d64-449c-b6c4-e82d877249b7 tempest-CreateVolumesFromImageTest-531355877 None] Lock "cinder-quobyte-3910335d-4152-4575-a7da-fc73319b4cc6" acquired by "delete_volume" :: waited 0.017s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:49:53 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9e025f-cf23-4da7-ba15-1a238c6b3ce9]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:49:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1b850fe9-8d64-449c-b6c4-e82d877249b7 tempest-CreateVolumesFromImageTest-531355877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3910335d-4152-4575-a7da-fc73319b4cc6 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:53 devstack sudo[101396]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7482bfd4-41ef-40a6-b54a-8cab11dd1b76 tempest-CreateVolumesFromImageTest-531355877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.339s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:53 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-7482bfd4-41ef-40a6-b54a-8cab11dd1b76 tempest-CreateVolumesFromImageTest-531355877 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:49:53 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-7482bfd4-41ef-40a6-b54a-8cab11dd1b76 tempest-CreateVolumesFromImageTest-531355877 None] Deleted volume successfully. Jul 17 19:49:53 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7482bfd4-41ef-40a6-b54a-8cab11dd1b76 tempest-CreateVolumesFromImageTest-531355877 None] Lock "cinder-3a71ef73-a95e-4b1d-9298-99f5a3382f78-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:49:53 devstack sudo[101400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3910335d-4152-4575-a7da-fc73319b4cc6 Jul 17 19:49:53 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:54 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1b850fe9-8d64-449c-b6c4-e82d877249b7 tempest-CreateVolumesFromImageTest-531355877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3910335d-4152-4575-a7da-fc73319b4cc6" returned: 0 in 0.437s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1b850fe9-8d64-449c-b6c4-e82d877249b7 tempest-CreateVolumesFromImageTest-531355877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3910335d-4152-4575-a7da-fc73319b4cc6 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:54 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3910335d-4152-4575-a7da-fc73319b4cc6 Jul 17 19:49:54 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:54 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1b850fe9-8d64-449c-b6c4-e82d877249b7 tempest-CreateVolumesFromImageTest-531355877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3910335d-4152-4575-a7da-fc73319b4cc6" returned: 0 in 0.276s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:54 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1b850fe9-8d64-449c-b6c4-e82d877249b7 tempest-CreateVolumesFromImageTest-531355877 None] Lock "cinder-quobyte-3910335d-4152-4575-a7da-fc73319b4cc6" released by "delete_volume" :: held 0.777s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:49:54 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-1b850fe9-8d64-449c-b6c4-e82d877249b7 tempest-CreateVolumesFromImageTest-531355877 None] Created reservations ['b2784ab2-1a29-48b3-959a-306c99227833', '171efe62-46c0-4f91-8013-0f20daa8f9a7', 'e8232152-ce47-4234-a433-5f7d9fe70c48', '0b2bd34f-b921-462c-8bf9-5702bd67402d'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:49:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1b850fe9-8d64-449c-b6c4-e82d877249b7 tempest-CreateVolumesFromImageTest-531355877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:49:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1b850fe9-8d64-449c-b6c4-e82d877249b7 tempest-CreateVolumesFromImageTest-531355877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:54 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-1b850fe9-8d64-449c-b6c4-e82d877249b7 tempest-CreateVolumesFromImageTest-531355877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:49:54 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-1b850fe9-8d64-449c-b6c4-e82d877249b7 tempest-CreateVolumesFromImageTest-531355877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:49:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1b850fe9-8d64-449c-b6c4-e82d877249b7 tempest-CreateVolumesFromImageTest-531355877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1b850fe9-8d64-449c-b6c4-e82d877249b7 tempest-CreateVolumesFromImageTest-531355877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:54 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:49:54 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:54 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-489e04dc-0456-429d-8d0c-42ffbd27afac tempest-CreateVolumesFromImageTest-531355877 None] Acquiring lock "cinder-204d238d-8a91-4481-97d9-bb7cb88776da-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:49:54 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-489e04dc-0456-429d-8d0c-42ffbd27afac tempest-CreateVolumesFromImageTest-531355877 None] Lock "cinder-204d238d-8a91-4481-97d9-bb7cb88776da-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:49:54 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-489e04dc-0456-429d-8d0c-42ffbd27afac tempest-CreateVolumesFromImageTest-531355877 None] Acquiring lock "cinder-quobyte-204d238d-8a91-4481-97d9-bb7cb88776da" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:49:54 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-489e04dc-0456-429d-8d0c-42ffbd27afac tempest-CreateVolumesFromImageTest-531355877 None] Lock "cinder-quobyte-204d238d-8a91-4481-97d9-bb7cb88776da" acquired by "delete_volume" :: waited 0.022s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:49:54 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1e7c2e-b9d6-45ef-b1a1-be3234f5451b]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:49:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-489e04dc-0456-429d-8d0c-42ffbd27afac tempest-CreateVolumesFromImageTest-531355877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-204d238d-8a91-4481-97d9-bb7cb88776da {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:54 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1b850fe9-8d64-449c-b6c4-e82d877249b7 tempest-CreateVolumesFromImageTest-531355877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.370s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:54 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-1b850fe9-8d64-449c-b6c4-e82d877249b7 tempest-CreateVolumesFromImageTest-531355877 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:49:55 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-1b850fe9-8d64-449c-b6c4-e82d877249b7 tempest-CreateVolumesFromImageTest-531355877 None] Deleted volume successfully. Jul 17 19:49:55 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1b850fe9-8d64-449c-b6c4-e82d877249b7 tempest-CreateVolumesFromImageTest-531355877 None] Lock "cinder-3910335d-4152-4575-a7da-fc73319b4cc6-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:49:55 devstack sudo[101413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-204d238d-8a91-4481-97d9-bb7cb88776da Jul 17 19:49:55 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:55 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-489e04dc-0456-429d-8d0c-42ffbd27afac tempest-CreateVolumesFromImageTest-531355877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-204d238d-8a91-4481-97d9-bb7cb88776da" returned: 0 in 0.487s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-489e04dc-0456-429d-8d0c-42ffbd27afac tempest-CreateVolumesFromImageTest-531355877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-204d238d-8a91-4481-97d9-bb7cb88776da {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:55 devstack sudo[101419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-204d238d-8a91-4481-97d9-bb7cb88776da Jul 17 19:49:55 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:55 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-489e04dc-0456-429d-8d0c-42ffbd27afac tempest-CreateVolumesFromImageTest-531355877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-204d238d-8a91-4481-97d9-bb7cb88776da" returned: 0 in 0.253s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:55 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-489e04dc-0456-429d-8d0c-42ffbd27afac tempest-CreateVolumesFromImageTest-531355877 None] Lock "cinder-quobyte-204d238d-8a91-4481-97d9-bb7cb88776da" released by "delete_volume" :: held 0.814s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:49:55 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-489e04dc-0456-429d-8d0c-42ffbd27afac tempest-CreateVolumesFromImageTest-531355877 None] Created reservations ['65db3185-2f0e-4b3b-b909-9285be4aedc8', '23a583d0-8a77-4147-a563-c5683f06c071', 'a9e32525-6e92-4eba-b776-f622f1824a9b', '562fbd94-f09f-4f8c-912b-6fd9c57cef23'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:49:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-489e04dc-0456-429d-8d0c-42ffbd27afac tempest-CreateVolumesFromImageTest-531355877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:49:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-489e04dc-0456-429d-8d0c-42ffbd27afac tempest-CreateVolumesFromImageTest-531355877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:55 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-489e04dc-0456-429d-8d0c-42ffbd27afac tempest-CreateVolumesFromImageTest-531355877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:49:55 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-489e04dc-0456-429d-8d0c-42ffbd27afac tempest-CreateVolumesFromImageTest-531355877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:49:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-489e04dc-0456-429d-8d0c-42ffbd27afac tempest-CreateVolumesFromImageTest-531355877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-489e04dc-0456-429d-8d0c-42ffbd27afac tempest-CreateVolumesFromImageTest-531355877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:55 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:49:55 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:56 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c4dc9546-2e05-4dab-af6b-81418cd859f4 tempest-CreateVolumesFromImageTest-531355877 None] Acquiring lock "cinder-ccb34ada-ec5d-4b38-99be-2645de9f8900-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:49:56 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c4dc9546-2e05-4dab-af6b-81418cd859f4 tempest-CreateVolumesFromImageTest-531355877 None] Lock "cinder-ccb34ada-ec5d-4b38-99be-2645de9f8900-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:49:56 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c4dc9546-2e05-4dab-af6b-81418cd859f4 tempest-CreateVolumesFromImageTest-531355877 None] Acquiring lock "cinder-quobyte-ccb34ada-ec5d-4b38-99be-2645de9f8900" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:49:56 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c4dc9546-2e05-4dab-af6b-81418cd859f4 tempest-CreateVolumesFromImageTest-531355877 None] Lock "cinder-quobyte-ccb34ada-ec5d-4b38-99be-2645de9f8900" acquired by "delete_volume" :: waited 0.024s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:49:56 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-489e04dc-0456-429d-8d0c-42ffbd27afac tempest-CreateVolumesFromImageTest-531355877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.370s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:56 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-489e04dc-0456-429d-8d0c-42ffbd27afac tempest-CreateVolumesFromImageTest-531355877 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:49:56 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-489e04dc-0456-429d-8d0c-42ffbd27afac tempest-CreateVolumesFromImageTest-531355877 None] Deleted volume successfully. Jul 17 19:49:56 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cd8012-0a56-4448-86d6-961c9526e887]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:49:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c4dc9546-2e05-4dab-af6b-81418cd859f4 tempest-CreateVolumesFromImageTest-531355877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ccb34ada-ec5d-4b38-99be-2645de9f8900 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:56 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-489e04dc-0456-429d-8d0c-42ffbd27afac tempest-CreateVolumesFromImageTest-531355877 None] Lock "cinder-204d238d-8a91-4481-97d9-bb7cb88776da-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:49:56 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ccb34ada-ec5d-4b38-99be-2645de9f8900 Jul 17 19:49:56 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:56 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c4dc9546-2e05-4dab-af6b-81418cd859f4 tempest-CreateVolumesFromImageTest-531355877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ccb34ada-ec5d-4b38-99be-2645de9f8900" returned: 0 in 0.434s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c4dc9546-2e05-4dab-af6b-81418cd859f4 tempest-CreateVolumesFromImageTest-531355877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ccb34ada-ec5d-4b38-99be-2645de9f8900 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:56 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ccb34ada-ec5d-4b38-99be-2645de9f8900 Jul 17 19:49:56 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:56 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c4dc9546-2e05-4dab-af6b-81418cd859f4 tempest-CreateVolumesFromImageTest-531355877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ccb34ada-ec5d-4b38-99be-2645de9f8900" returned: 0 in 0.328s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:57 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c4dc9546-2e05-4dab-af6b-81418cd859f4 tempest-CreateVolumesFromImageTest-531355877 None] Lock "cinder-quobyte-ccb34ada-ec5d-4b38-99be-2645de9f8900" released by "delete_volume" :: held 0.831s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:49:57 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-c4dc9546-2e05-4dab-af6b-81418cd859f4 tempest-CreateVolumesFromImageTest-531355877 None] Created reservations ['24479036-88f5-48bd-b023-62043be3c0ef', 'b6c6709c-2caa-4037-8ca4-2ec379113aea', '0d927194-7709-4fd2-8181-c23eba9c52c3', 'b8f9bc1e-203c-4c7c-a15d-4783b7469b8c'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:49:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c4dc9546-2e05-4dab-af6b-81418cd859f4 tempest-CreateVolumesFromImageTest-531355877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:49:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c4dc9546-2e05-4dab-af6b-81418cd859f4 tempest-CreateVolumesFromImageTest-531355877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:49:57 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c4dc9546-2e05-4dab-af6b-81418cd859f4 tempest-CreateVolumesFromImageTest-531355877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:49:57 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c4dc9546-2e05-4dab-af6b-81418cd859f4 tempest-CreateVolumesFromImageTest-531355877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:49:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c4dc9546-2e05-4dab-af6b-81418cd859f4 tempest-CreateVolumesFromImageTest-531355877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:49:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c4dc9546-2e05-4dab-af6b-81418cd859f4 tempest-CreateVolumesFromImageTest-531355877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:49:57 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:49:57 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:49:57 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Jul 17 19:49:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c4dc9546-2e05-4dab-af6b-81418cd859f4 tempest-CreateVolumesFromImageTest-531355877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.371s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:49:57 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-c4dc9546-2e05-4dab-af6b-81418cd859f4 tempest-CreateVolumesFromImageTest-531355877 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:49:57 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-c4dc9546-2e05-4dab-af6b-81418cd859f4 tempest-CreateVolumesFromImageTest-531355877 None] Deleted volume successfully. Jul 17 19:49:57 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c4dc9546-2e05-4dab-af6b-81418cd859f4 tempest-CreateVolumesFromImageTest-531355877 None] Lock "cinder-ccb34ada-ec5d-4b38-99be-2645de9f8900-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:50:01 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:50:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] Flow 'volume_create_manager' (71128a67-165e-408d-9bee-021d1649ccdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28663615-f2fe-4119-a5d1-76f43e35bc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28663615-f2fe-4119-a5d1-76f43e35bc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1444404998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b957c5a-db28-4d1a-b260-ce5265fc465e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9face0a1268241ce953f3a6d4d66f364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:02Z,use_quota=True,user_id='97b69e44d58b4b24a448e2aa3c1d1de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0393ae52-922a-4968-8673-a937568fa85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0393ae52-922a-4968-8673-a937568fa85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d50bc6-36f9-4858-8989-dee009c8dba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d50bc6-36f9-4858-8989-dee009c8dba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b957c5a-db28-4d1a-b260-ce5265fc465e', 'volume_name': 'volume-6b957c5a-db28-4d1a-b260-ce5265fc465e', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d690157d-0730-4706-8f2f-7d22c5eff7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d690157d-0730-4706-8f2f-7d22c5eff7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bef2de1-0629-4918-b42f-b3a4f89c6492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:01 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] Volume 6b957c5a-db28-4d1a-b260-ce5265fc465e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b957c5a-db28-4d1a-b260-ce5265fc465e', 'volume_size': 1} Jul 17 19:50:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:01 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1444404998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b957c5a-db28-4d1a-b260-ce5265fc465e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9face0a1268241ce953f3a6d4d66f364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:02Z,use_quota=True,user_id='97b69e44d58b4b24a448e2aa3c1d1de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:50:01 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] Creating volume 6b957c5a-db28-4d1a-b260-ce5265fc465e {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:50:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:01 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:01 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:01 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:50:01 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:50:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:01 devstack sudo[101448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e 1073741824 Jul 17 19:50:01 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:02 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e 1073741824" returned: 0 in 0.525s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:02 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e Jul 17 19:50:02 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:02 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e" returned: 0 in 0.331s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:02 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:50:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:02 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bef2de1-0629-4918-b42f-b3a4f89c6492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b957c5a-db28-4d1a-b260-ce5265fc465e', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:02 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553af8ef-fc6d-4a82-b04c-ab180d2668a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:02 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] Volume volume-6b957c5a-db28-4d1a-b260-ce5265fc465e (6b957c5a-db28-4d1a-b260-ce5265fc465e): created successfully Jul 17 19:50:02 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553af8ef-fc6d-4a82-b04c-ab180d2668a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:02 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] Flow 'volume_create_manager' (71128a67-165e-408d-9bee-021d1649ccdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:02 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-f65b3bcf-0ffe-40d7-815d-74d04996145e tempest-CreateVolumesFromSnapshotTest-1441430589 None] Created volume successfully. Jul 17 19:50:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-43dc4b00-7040-47ed-9a62-e4386d106922 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-43dc4b00-7040-47ed-9a62-e4386d106922 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:04 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-43dc4b00-7040-47ed-9a62-e4386d106922 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Creating offline snapshot 785f7b35-0e5d-4408-bbe2-0a745970d8d4 of volume 6b957c5a-db28-4d1a-b260-ce5265fc465e {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:50:04 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ab5600-6c5d-4deb-b759-d85b87903663]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:50:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-43dc4b00-7040-47ed-9a62-e4386d106922 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:04 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e Jul 17 19:50:04 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:04 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-43dc4b00-7040-47ed-9a62-e4386d106922 tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e" returned: 0 in 0.536s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-43dc4b00-7040-47ed-9a62-e4386d106922 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e.785f7b35-0e5d-4408-bbe2-0a745970d8d4 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:04 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e.785f7b35-0e5d-4408-bbe2-0a745970d8d4 1G Jul 17 19:50:04 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:05 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-43dc4b00-7040-47ed-9a62-e4386d106922 tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e.785f7b35-0e5d-4408-bbe2-0a745970d8d4 1G" returned: 0 in 0.534s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-43dc4b00-7040-47ed-9a62-e4386d106922 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b957c5a-db28-4d1a-b260-ce5265fc465e -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e.785f7b35-0e5d-4408-bbe2-0a745970d8d4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:05 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b957c5a-db28-4d1a-b260-ce5265fc465e -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e.785f7b35-0e5d-4408-bbe2-0a745970d8d4 Jul 17 19:50:05 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:05 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-43dc4b00-7040-47ed-9a62-e4386d106922 tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b957c5a-db28-4d1a-b260-ce5265fc465e -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e.785f7b35-0e5d-4408-bbe2-0a745970d8d4" returned: 0 in 0.362s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:05 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-43dc4b00-7040-47ed-9a62-e4386d106922 tempest-CreateVolumesFromSnapshotTest-1441430589 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e.785f7b35-0e5d-4408-bbe2-0a745970d8d4 is being set with open permissions: ugo+rw Jul 17 19:50:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-43dc4b00-7040-47ed-9a62-e4386d106922 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e.785f7b35-0e5d-4408-bbe2-0a745970d8d4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:05 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e.785f7b35-0e5d-4408-bbe2-0a745970d8d4 Jul 17 19:50:05 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:06 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-43dc4b00-7040-47ed-9a62-e4386d106922 tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e.785f7b35-0e5d-4408-bbe2-0a745970d8d4" returned: 0 in 0.346s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-43dc4b00-7040-47ed-9a62-e4386d106922 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:06 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e.info Jul 17 19:50:06 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:06 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-43dc4b00-7040-47ed-9a62-e4386d106922 tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e.info" returned: 0 in 0.279s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:06 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-43dc4b00-7040-47ed-9a62-e4386d106922 tempest-CreateVolumesFromSnapshotTest-1441430589 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e.info is being set with open permissions: ugo+rw Jul 17 19:50:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-43dc4b00-7040-47ed-9a62-e4386d106922 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:06 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e.info Jul 17 19:50:06 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:06 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-43dc4b00-7040-47ed-9a62-e4386d106922 tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e.info" returned: 0 in 0.345s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-43dc4b00-7040-47ed-9a62-e4386d106922 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.519s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:06 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-43dc4b00-7040-47ed-9a62-e4386d106922 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Create snapshot completed successfully Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Flow 'volume_create_manager' (6bdb768f-2192-4ff8-b3fd-9fab3d914e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62358b9c-7dcc-40d4-a61a-147079f3f8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62358b9c-7dcc-40d4-a61a-147079f3f8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1732902532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e39ddd1-eab3-4c3d-80c6-b1487b9f8e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9face0a1268241ce953f3a6d4d66f364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:08Z,use_quota=True,user_id='97b69e44d58b4b24a448e2aa3c1d1de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9075695c-6b03-4adc-81ad-b4f756014a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9075695c-6b03-4adc-81ad-b4f756014a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e43480b4-3a53-4b3d-9d2a-1ba0bf7ac13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e43480b4-3a53-4b3d-9d2a-1ba0bf7ac13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e39ddd1-eab3-4c3d-80c6-b1487b9f8e73', 'volume_name': 'volume-6e39ddd1-eab3-4c3d-80c6-b1487b9f8e73', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d71c661-27a3-4e01-95d4-5311fcad9399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d71c661-27a3-4e01-95d4-5311fcad9399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a118f4e-3a3b-4d20-a548-a5fb3c2892d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:08 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Volume 6e39ddd1-eab3-4c3d-80c6-b1487b9f8e73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e39ddd1-eab3-4c3d-80c6-b1487b9f8e73', 'volume_size': 1} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1732902532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e39ddd1-eab3-4c3d-80c6-b1487b9f8e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9face0a1268241ce953f3a6d4d66f364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:08Z,use_quota=True,user_id='97b69e44d58b4b24a448e2aa3c1d1de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Creating volume 6e39ddd1-eab3-4c3d-80c6-b1487b9f8e73 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:50:08 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6e39ddd1-eab3-4c3d-80c6-b1487b9f8e73 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:08 devstack sudo[101481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6e39ddd1-eab3-4c3d-80c6-b1487b9f8e73 1073741824 Jul 17 19:50:08 devstack sudo[101481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=100,cinder:UPDATE=119,cinder:INSERT=25,cinder:DELETE=11 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=95,cinder:UPDATE=126,cinder:INSERT=31,cinder:DELETE=10 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Flow 'volume_create_manager' (5e879ffb-079b-4368-9d81-8e2f09b49637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b1d4bde-cdb0-404a-9cf4-82f966c82197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b1d4bde-cdb0-404a-9cf4-82f966c82197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1215815650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f6a58d-613f-467b-b991-e01e961ff95f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9face0a1268241ce953f3a6d4d66f364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:08Z,use_quota=True,user_id='97b69e44d58b4b24a448e2aa3c1d1de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e56330b-e75c-41bb-95dd-643280457e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e56330b-e75c-41bb-95dd-643280457e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6954da17-6ccf-4dcf-96ea-c8c43f0bed0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6954da17-6ccf-4dcf-96ea-c8c43f0bed0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8f6a58d-613f-467b-b991-e01e961ff95f', 'volume_name': 'volume-c8f6a58d-613f-467b-b991-e01e961ff95f', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309e955c-d105-4839-bf59-b0aa8c214a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309e955c-d105-4839-bf59-b0aa8c214a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f507fd1-7b5e-40df-94f8-ef023cdf0e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:08 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Volume c8f6a58d-613f-467b-b991-e01e961ff95f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8f6a58d-613f-467b-b991-e01e961ff95f', 'volume_size': 1} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:08 devstack sudo[101481]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6e39ddd1-eab3-4c3d-80c6-b1487b9f8e73 1073741824" returned: 0 in 0.685s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6e39ddd1-eab3-4c3d-80c6-b1487b9f8e73 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:08 devstack sudo[101487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6e39ddd1-eab3-4c3d-80c6-b1487b9f8e73 Jul 17 19:50:08 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Flow 'volume_create_manager' (7683ea66-fc45-40e1-a7f3-cad73fe84f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74bada3a-55ac-4d90-86a6-ee564509f732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74bada3a-55ac-4d90-86a6-ee564509f732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1083879523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87031d68-54cf-43fa-ace2-a127af24fb13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9face0a1268241ce953f3a6d4d66f364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:09Z,use_quota=True,user_id='97b69e44d58b4b24a448e2aa3c1d1de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5914591-9311-4c4d-afa0-1ebf89a1c5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5914591-9311-4c4d-afa0-1ebf89a1c5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b0b773-48d3-4f61-a7c1-a313eccd4bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b0b773-48d3-4f61-a7c1-a313eccd4bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87031d68-54cf-43fa-ace2-a127af24fb13', 'volume_name': 'volume-87031d68-54cf-43fa-ace2-a127af24fb13', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09a74535-c9d7-4f93-95ac-90b87726bd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09a74535-c9d7-4f93-95ac-90b87726bd68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (448aa502-8415-45f0-9b83-c2ccd5e768b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:09 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Volume 87031d68-54cf-43fa-ace2-a127af24fb13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87031d68-54cf-43fa-ace2-a127af24fb13', 'volume_size': 1} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:09 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6e39ddd1-eab3-4c3d-80c6-b1487b9f8e73" returned: 0 in 0.433s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.517s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1215815650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f6a58d-613f-467b-b991-e01e961ff95f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9face0a1268241ce953f3a6d4d66f364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:08Z,use_quota=True,user_id='97b69e44d58b4b24a448e2aa3c1d1de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Creating volume c8f6a58d-613f-467b-b991-e01e961ff95f {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:50:09 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c8f6a58d-613f-467b-b991-e01e961ff95f 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:09 devstack sudo[101490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c8f6a58d-613f-467b-b991-e01e961ff95f 1073741824 Jul 17 19:50:09 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a118f4e-3a3b-4d20-a548-a5fb3c2892d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e39ddd1-eab3-4c3d-80c6-b1487b9f8e73', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1cdfe7e-d052-446d-8771-0d21dd190963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:09 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Volume volume-6e39ddd1-eab3-4c3d-80c6-b1487b9f8e73 (6e39ddd1-eab3-4c3d-80c6-b1487b9f8e73): created successfully Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1cdfe7e-d052-446d-8771-0d21dd190963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Flow 'volume_create_manager' (6bdb768f-2192-4ff8-b3fd-9fab3d914e51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:09 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-939c6012-5d3d-48b9-9c3b-f0b6de2c0318 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Created volume successfully. Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Flow 'volume_create_manager' (9e03b9ac-943f-4b4a-b952-39fd2aea9eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9907b0cd-f17e-48d9-b150-1241dfe50990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9907b0cd-f17e-48d9-b150-1241dfe50990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1058794507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11b2e454-1f18-4e95-b692-4cb86f9b108b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9face0a1268241ce953f3a6d4d66f364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:09Z,use_quota=True,user_id='97b69e44d58b4b24a448e2aa3c1d1de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbf83226-74bb-4fd5-b57e-afe866aa82d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbf83226-74bb-4fd5-b57e-afe866aa82d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a686c0ff-5b80-4cda-a371-ce705c99e269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a686c0ff-5b80-4cda-a371-ce705c99e269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11b2e454-1f18-4e95-b692-4cb86f9b108b', 'volume_name': 'volume-11b2e454-1f18-4e95-b692-4cb86f9b108b', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f27882b-89ed-4a8f-8d03-ae3bafba1064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f27882b-89ed-4a8f-8d03-ae3bafba1064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b7932b-2a18-427e-a5b1-4941a7e6efbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:09 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Volume 11b2e454-1f18-4e95-b692-4cb86f9b108b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11b2e454-1f18-4e95-b692-4cb86f9b108b', 'volume_size': 1} Jul 17 19:50:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:10 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c8f6a58d-613f-467b-b991-e01e961ff95f 1073741824" returned: 0 in 0.715s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c8f6a58d-613f-467b-b991-e01e961ff95f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:10 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c8f6a58d-613f-467b-b991-e01e961ff95f Jul 17 19:50:10 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Flow 'volume_create_manager' (aebe5386-6d2f-40ed-943f-da5e25244d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9f949e-b15c-4a46-9d18-bc310d37d286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9f949e-b15c-4a46-9d18-bc310d37d286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1915045620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73e6a1dd-9ec7-4aef-8e2f-02647f326088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9face0a1268241ce953f3a6d4d66f364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:10Z,use_quota=True,user_id='97b69e44d58b4b24a448e2aa3c1d1de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01db8a5b-6416-4fb7-b95e-f1ed78c6fae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01db8a5b-6416-4fb7-b95e-f1ed78c6fae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cccc7ce-c187-4e93-ae82-10cdfa672b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cccc7ce-c187-4e93-ae82-10cdfa672b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73e6a1dd-9ec7-4aef-8e2f-02647f326088', 'volume_name': 'volume-73e6a1dd-9ec7-4aef-8e2f-02647f326088', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b4b8a1d-feff-47ed-b57c-6c4b9f024b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b4b8a1d-feff-47ed-b57c-6c4b9f024b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09fbe4f8-d6cd-4ddf-a35d-dbba3cdf2099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:10 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Volume 73e6a1dd-9ec7-4aef-8e2f-02647f326088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73e6a1dd-9ec7-4aef-8e2f-02647f326088', 'volume_size': 1} Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:10 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c8f6a58d-613f-467b-b991-e01e961ff95f" returned: 0 in 0.395s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.310s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1083879523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87031d68-54cf-43fa-ace2-a127af24fb13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9face0a1268241ce953f3a6d4d66f364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:09Z,use_quota=True,user_id='97b69e44d58b4b24a448e2aa3c1d1de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Creating volume 87031d68-54cf-43fa-ace2-a127af24fb13 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:50:10 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87031d68-54cf-43fa-ace2-a127af24fb13 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:10 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87031d68-54cf-43fa-ace2-a127af24fb13 1073741824 Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f507fd1-7b5e-40df-94f8-ef023cdf0e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8f6a58d-613f-467b-b991-e01e961ff95f', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:10 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7847529-3c06-4f83-b5b2-03b53bea7293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:10 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Volume volume-c8f6a58d-613f-467b-b991-e01e961ff95f (c8f6a58d-613f-467b-b991-e01e961ff95f): created successfully Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7847529-3c06-4f83-b5b2-03b53bea7293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Flow 'volume_create_manager' (5e879ffb-079b-4368-9d81-8e2f09b49637) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:10 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-24b85341-7c97-43c5-9ab3-a0ea2febe06f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Created volume successfully. Jul 17 19:50:11 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87031d68-54cf-43fa-ace2-a127af24fb13 1073741824" returned: 0 in 0.642s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87031d68-54cf-43fa-ace2-a127af24fb13 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:11 devstack sudo[101506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87031d68-54cf-43fa-ace2-a127af24fb13 Jul 17 19:50:11 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:11 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87031d68-54cf-43fa-ace2-a127af24fb13" returned: 0 in 0.299s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:50:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.784s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1058794507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11b2e454-1f18-4e95-b692-4cb86f9b108b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9face0a1268241ce953f3a6d4d66f364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:09Z,use_quota=True,user_id='97b69e44d58b4b24a448e2aa3c1d1de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:50:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Creating volume 11b2e454-1f18-4e95-b692-4cb86f9b108b {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:50:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:50:11 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:50:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-11b2e454-1f18-4e95-b692-4cb86f9b108b 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:11 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-11b2e454-1f18-4e95-b692-4cb86f9b108b 1073741824 Jul 17 19:50:11 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (448aa502-8415-45f0-9b83-c2ccd5e768b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87031d68-54cf-43fa-ace2-a127af24fb13', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34401c08-4a89-410f-8617-d1f2b89da200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:11 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Volume volume-87031d68-54cf-43fa-ace2-a127af24fb13 (87031d68-54cf-43fa-ace2-a127af24fb13): created successfully Jul 17 19:50:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34401c08-4a89-410f-8617-d1f2b89da200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Flow 'volume_create_manager' (7683ea66-fc45-40e1-a7f3-cad73fe84f27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:11 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e60cf740-7668-4242-8449-32b9cf20b2f9 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Created volume successfully. Jul 17 19:50:12 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-11b2e454-1f18-4e95-b692-4cb86f9b108b 1073741824" returned: 0 in 0.575s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-11b2e454-1f18-4e95-b692-4cb86f9b108b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:12 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-11b2e454-1f18-4e95-b692-4cb86f9b108b Jul 17 19:50:12 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:12 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-11b2e454-1f18-4e95-b692-4cb86f9b108b" returned: 0 in 0.296s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:50:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.162s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1915045620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73e6a1dd-9ec7-4aef-8e2f-02647f326088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9face0a1268241ce953f3a6d4d66f364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:10Z,use_quota=True,user_id='97b69e44d58b4b24a448e2aa3c1d1de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:50:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Creating volume 73e6a1dd-9ec7-4aef-8e2f-02647f326088 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:50:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:50:12 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:50:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-73e6a1dd-9ec7-4aef-8e2f-02647f326088 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b7932b-2a18-427e-a5b1-4941a7e6efbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11b2e454-1f18-4e95-b692-4cb86f9b108b', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:12 devstack sudo[101518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-73e6a1dd-9ec7-4aef-8e2f-02647f326088 1073741824 Jul 17 19:50:12 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c61036a-2833-417c-bcff-316edf6d3bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:12 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Volume volume-11b2e454-1f18-4e95-b692-4cb86f9b108b (11b2e454-1f18-4e95-b692-4cb86f9b108b): created successfully Jul 17 19:50:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c61036a-2833-417c-bcff-316edf6d3bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Flow 'volume_create_manager' (9e03b9ac-943f-4b4a-b952-39fd2aea9eca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:12 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-464cbd86-f406-44a7-8ca5-154fe3420e17 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Created volume successfully. Jul 17 19:50:13 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-73e6a1dd-9ec7-4aef-8e2f-02647f326088 1073741824" returned: 0 in 0.626s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-73e6a1dd-9ec7-4aef-8e2f-02647f326088 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:13 devstack sudo[101524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-73e6a1dd-9ec7-4aef-8e2f-02647f326088 Jul 17 19:50:13 devstack sudo[101524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:13 devstack sudo[101524]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-73e6a1dd-9ec7-4aef-8e2f-02647f326088" returned: 0 in 0.286s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:13 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:50:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09fbe4f8-d6cd-4ddf-a35d-dbba3cdf2099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73e6a1dd-9ec7-4aef-8e2f-02647f326088', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3558f7de-6d96-43aa-abf2-5682263f5415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:13 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Volume volume-73e6a1dd-9ec7-4aef-8e2f-02647f326088 (73e6a1dd-9ec7-4aef-8e2f-02647f326088): created successfully Jul 17 19:50:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3558f7de-6d96-43aa-abf2-5682263f5415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Flow 'volume_create_manager' (aebe5386-6d2f-40ed-943f-da5e25244d79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:13 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-d5a15ef9-7676-48ce-9bf0-ec366570fe94 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Created volume successfully. Jul 17 19:50:14 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6af9f6e4-b2e1-4ddb-aa1a-f60cd5eca971 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "cinder-73e6a1dd-9ec7-4aef-8e2f-02647f326088-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:50:14 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6af9f6e4-b2e1-4ddb-aa1a-f60cd5eca971 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "cinder-73e6a1dd-9ec7-4aef-8e2f-02647f326088-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:50:14 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6af9f6e4-b2e1-4ddb-aa1a-f60cd5eca971 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "cinder-quobyte-73e6a1dd-9ec7-4aef-8e2f-02647f326088" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:50:14 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6af9f6e4-b2e1-4ddb-aa1a-f60cd5eca971 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "cinder-quobyte-73e6a1dd-9ec7-4aef-8e2f-02647f326088" acquired by "delete_volume" :: waited 0.020s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:50:14 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf41811-a5c0-4460-8b62-0f3b99f8993d]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:50:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6af9f6e4-b2e1-4ddb-aa1a-f60cd5eca971 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-73e6a1dd-9ec7-4aef-8e2f-02647f326088 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:14 devstack sudo[101527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-73e6a1dd-9ec7-4aef-8e2f-02647f326088 Jul 17 19:50:14 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:15 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6af9f6e4-b2e1-4ddb-aa1a-f60cd5eca971 tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-73e6a1dd-9ec7-4aef-8e2f-02647f326088" returned: 0 in 0.416s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6af9f6e4-b2e1-4ddb-aa1a-f60cd5eca971 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-73e6a1dd-9ec7-4aef-8e2f-02647f326088 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:15 devstack sudo[101533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-73e6a1dd-9ec7-4aef-8e2f-02647f326088 Jul 17 19:50:15 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:50:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:15 devstack sudo[101535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:50:15 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:15 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6af9f6e4-b2e1-4ddb-aa1a-f60cd5eca971 tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-73e6a1dd-9ec7-4aef-8e2f-02647f326088" returned: 0 in 0.388s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:15 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6af9f6e4-b2e1-4ddb-aa1a-f60cd5eca971 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "cinder-quobyte-73e6a1dd-9ec7-4aef-8e2f-02647f326088" released by "delete_volume" :: held 0.870s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:50:15 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-6af9f6e4-b2e1-4ddb-aa1a-f60cd5eca971 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Created reservations ['313893a9-c132-46c8-afd2-002b1b3a54d9', 'ccd37947-11d2-44df-ab96-de05404b9b4b', '20c32f91-3f31-4061-92a4-a47fa1460b25', '9eda513b-5547-427c-8eb9-2a3430141629'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:50:15 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.426s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:15 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:50:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager._thread_info {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:50:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread count: 28 {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 19:50:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread info: [<_MainThread(MainThread, started 130066227544192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 19:50:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6af9f6e4-b2e1-4ddb-aa1a-f60cd5eca971 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6af9f6e4-b2e1-4ddb-aa1a-f60cd5eca971 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6af9f6e4-b2e1-4ddb-aa1a-f60cd5eca971 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6af9f6e4-b2e1-4ddb-aa1a-f60cd5eca971 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6af9f6e4-b2e1-4ddb-aa1a-f60cd5eca971 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6af9f6e4-b2e1-4ddb-aa1a-f60cd5eca971 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:15 devstack sudo[101539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:50:15 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:15 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e51e8ba8-7623-4804-b22b-5192be9402f3 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "cinder-11b2e454-1f18-4e95-b692-4cb86f9b108b-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:50:15 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e51e8ba8-7623-4804-b22b-5192be9402f3 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "cinder-11b2e454-1f18-4e95-b692-4cb86f9b108b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:50:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e51e8ba8-7623-4804-b22b-5192be9402f3 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "cinder-quobyte-11b2e454-1f18-4e95-b692-4cb86f9b108b" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:50:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e51e8ba8-7623-4804-b22b-5192be9402f3 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "cinder-quobyte-11b2e454-1f18-4e95-b692-4cb86f9b108b" acquired by "delete_volume" :: waited 0.026s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:50:16 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8925ec3-0c40-41b7-a60d-57f77d2d1499]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:50:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e51e8ba8-7623-4804-b22b-5192be9402f3 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-11b2e454-1f18-4e95-b692-4cb86f9b108b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:16 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6af9f6e4-b2e1-4ddb-aa1a-f60cd5eca971 tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.389s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:16 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-6af9f6e4-b2e1-4ddb-aa1a-f60cd5eca971 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:50:16 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-6af9f6e4-b2e1-4ddb-aa1a-f60cd5eca971 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Deleted volume successfully. Jul 17 19:50:16 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-11b2e454-1f18-4e95-b692-4cb86f9b108b Jul 17 19:50:16 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6af9f6e4-b2e1-4ddb-aa1a-f60cd5eca971 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "cinder-73e6a1dd-9ec7-4aef-8e2f-02647f326088-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:50:16 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e51e8ba8-7623-4804-b22b-5192be9402f3 tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-11b2e454-1f18-4e95-b692-4cb86f9b108b" returned: 0 in 0.496s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e51e8ba8-7623-4804-b22b-5192be9402f3 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-11b2e454-1f18-4e95-b692-4cb86f9b108b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:16 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-11b2e454-1f18-4e95-b692-4cb86f9b108b Jul 17 19:50:16 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:16 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e51e8ba8-7623-4804-b22b-5192be9402f3 tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-11b2e454-1f18-4e95-b692-4cb86f9b108b" returned: 0 in 0.398s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:17 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e51e8ba8-7623-4804-b22b-5192be9402f3 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "cinder-quobyte-11b2e454-1f18-4e95-b692-4cb86f9b108b" released by "delete_volume" :: held 0.969s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:50:17 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-e51e8ba8-7623-4804-b22b-5192be9402f3 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Created reservations ['0bcb6c20-da0f-4f73-bb87-e62e8e34294c', 'cc5f7164-9557-475a-a365-04752717b629', '8b17d375-77d5-43fb-9e30-fffdb4c8f23e', '7bc49ba1-491c-4b67-921d-d5a86cbf5da3'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:50:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e51e8ba8-7623-4804-b22b-5192be9402f3 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e51e8ba8-7623-4804-b22b-5192be9402f3 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:17 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e51e8ba8-7623-4804-b22b-5192be9402f3 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:17 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e51e8ba8-7623-4804-b22b-5192be9402f3 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e51e8ba8-7623-4804-b22b-5192be9402f3 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e51e8ba8-7623-4804-b22b-5192be9402f3 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:17 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:50:17 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:17 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e51e8ba8-7623-4804-b22b-5192be9402f3 tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.326s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:17 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-e51e8ba8-7623-4804-b22b-5192be9402f3 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:50:17 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e51e8ba8-7623-4804-b22b-5192be9402f3 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Deleted volume successfully. Jul 17 19:50:17 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e51e8ba8-7623-4804-b22b-5192be9402f3 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "cinder-11b2e454-1f18-4e95-b692-4cb86f9b108b-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:50:18 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d300307c-f1e0-459d-b88f-9687adae2bfe tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "cinder-87031d68-54cf-43fa-ace2-a127af24fb13-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:50:18 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d300307c-f1e0-459d-b88f-9687adae2bfe tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "cinder-87031d68-54cf-43fa-ace2-a127af24fb13-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:50:18 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d300307c-f1e0-459d-b88f-9687adae2bfe tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "cinder-quobyte-87031d68-54cf-43fa-ace2-a127af24fb13" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:50:18 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d300307c-f1e0-459d-b88f-9687adae2bfe tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "cinder-quobyte-87031d68-54cf-43fa-ace2-a127af24fb13" acquired by "delete_volume" :: waited 0.020s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:50:18 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e8fed0-76e3-4fcd-b5d0-c3516eadc959]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:50:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d300307c-f1e0-459d-b88f-9687adae2bfe tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87031d68-54cf-43fa-ace2-a127af24fb13 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:18 devstack sudo[101556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87031d68-54cf-43fa-ace2-a127af24fb13 Jul 17 19:50:18 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:18 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:50:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] Flow 'volume_create_manager' (7b5be76a-0116-4823-a3a6-09aa244bf183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7dfafe8-4483-481f-a424-73375da79355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7dfafe8-4483-481f-a424-73375da79355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1561811196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98dbaed7-0773-4d32-b9c5-04b0eaaffd90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe9d6a4191d404fbfcf2c29db2c68de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:19Z,use_quota=True,user_id='81dd39e1f1a846b6881c5cafd60204d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b28e23e-f7f8-4d62-83ea-55c9c3011e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b28e23e-f7f8-4d62-83ea-55c9c3011e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (976833b7-d554-43b3-8db0-602a2d926125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (976833b7-d554-43b3-8db0-602a2d926125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98dbaed7-0773-4d32-b9c5-04b0eaaffd90', 'volume_name': 'volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0348a0fd-ccd0-4402-a0fd-0da71e417317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0348a0fd-ccd0-4402-a0fd-0da71e417317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed183b3c-1604-4ee2-a561-4ce67402df4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:18 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] Volume 98dbaed7-0773-4d32-b9c5-04b0eaaffd90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90', 'volume_size': 1} Jul 17 19:50:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:18 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1561811196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98dbaed7-0773-4d32-b9c5-04b0eaaffd90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe9d6a4191d404fbfcf2c29db2c68de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:19Z,use_quota=True,user_id='81dd39e1f1a846b6881c5cafd60204d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:50:18 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] Creating volume 98dbaed7-0773-4d32-b9c5-04b0eaaffd90 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:50:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:18 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:18 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:18 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:50:18 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:50:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:18 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90 1073741824 Jul 17 19:50:18 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:18 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d300307c-f1e0-459d-b88f-9687adae2bfe tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87031d68-54cf-43fa-ace2-a127af24fb13" returned: 0 in 0.522s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d300307c-f1e0-459d-b88f-9687adae2bfe tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87031d68-54cf-43fa-ace2-a127af24fb13 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:19 devstack sudo[101563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87031d68-54cf-43fa-ace2-a127af24fb13 Jul 17 19:50:19 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:19 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d300307c-f1e0-459d-b88f-9687adae2bfe tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87031d68-54cf-43fa-ace2-a127af24fb13" returned: 0 in 0.369s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:19 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d300307c-f1e0-459d-b88f-9687adae2bfe tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "cinder-quobyte-87031d68-54cf-43fa-ace2-a127af24fb13" released by "delete_volume" :: held 0.957s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:50:19 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90 1073741824" returned: 0 in 0.576s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:19 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-d300307c-f1e0-459d-b88f-9687adae2bfe tempest-CreateVolumesFromSnapshotTest-1441430589 None] Created reservations ['018a504e-b357-429a-9b47-03f9c6b95f27', 'ef5a94f0-79d0-45cc-ab33-30b81ae7045e', 'cf475692-2493-4a94-8d0c-beded1e25a1a', '75608350-b1ed-4655-ba93-b35b137d654e'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:50:19 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90 Jul 17 19:50:19 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d300307c-f1e0-459d-b88f-9687adae2bfe tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d300307c-f1e0-459d-b88f-9687adae2bfe tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:19 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d300307c-f1e0-459d-b88f-9687adae2bfe tempest-CreateVolumesFromSnapshotTest-1441430589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:19 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d300307c-f1e0-459d-b88f-9687adae2bfe tempest-CreateVolumesFromSnapshotTest-1441430589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d300307c-f1e0-459d-b88f-9687adae2bfe tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d300307c-f1e0-459d-b88f-9687adae2bfe tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:19 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:50:19 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:19 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90" returned: 0 in 0.354s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:19 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:50:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed183b3c-1604-4ee2-a561-4ce67402df4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94841005-3be7-49d6-920b-130529d5d7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:19 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] Volume volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90 (98dbaed7-0773-4d32-b9c5-04b0eaaffd90): created successfully Jul 17 19:50:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94841005-3be7-49d6-920b-130529d5d7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] Flow 'volume_create_manager' (7b5be76a-0116-4823-a3a6-09aa244bf183) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:19 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-62949f53-b7fd-4c51-bc8f-97ee3def87c0 tempest-TestStampPattern-1595853218 None] Created volume successfully. Jul 17 19:50:19 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d300307c-f1e0-459d-b88f-9687adae2bfe tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.316s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:19 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-d300307c-f1e0-459d-b88f-9687adae2bfe tempest-CreateVolumesFromSnapshotTest-1441430589 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:50:20 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-d300307c-f1e0-459d-b88f-9687adae2bfe tempest-CreateVolumesFromSnapshotTest-1441430589 None] Deleted volume successfully. Jul 17 19:50:20 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d300307c-f1e0-459d-b88f-9687adae2bfe tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "cinder-87031d68-54cf-43fa-ace2-a127af24fb13-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:50:20 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a7ae41c9-ddfe-4668-b15e-833087175063 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "cinder-c8f6a58d-613f-467b-b991-e01e961ff95f-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:50:20 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a7ae41c9-ddfe-4668-b15e-833087175063 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "cinder-c8f6a58d-613f-467b-b991-e01e961ff95f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:50:20 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a7ae41c9-ddfe-4668-b15e-833087175063 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "cinder-quobyte-c8f6a58d-613f-467b-b991-e01e961ff95f" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:50:20 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a7ae41c9-ddfe-4668-b15e-833087175063 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "cinder-quobyte-c8f6a58d-613f-467b-b991-e01e961ff95f" acquired by "delete_volume" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:50:20 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c03f849-d16b-4d26-bd40-b111775c3ccc]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:50:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a7ae41c9-ddfe-4668-b15e-833087175063 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c8f6a58d-613f-467b-b991-e01e961ff95f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:20 devstack sudo[101580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c8f6a58d-613f-467b-b991-e01e961ff95f Jul 17 19:50:20 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:21 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a7ae41c9-ddfe-4668-b15e-833087175063 tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c8f6a58d-613f-467b-b991-e01e961ff95f" returned: 0 in 0.477s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a7ae41c9-ddfe-4668-b15e-833087175063 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c8f6a58d-613f-467b-b991-e01e961ff95f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:21 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c8f6a58d-613f-467b-b991-e01e961ff95f Jul 17 19:50:21 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:21 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a7ae41c9-ddfe-4668-b15e-833087175063 tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c8f6a58d-613f-467b-b991-e01e961ff95f" returned: 0 in 0.324s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:21 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a7ae41c9-ddfe-4668-b15e-833087175063 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "cinder-quobyte-c8f6a58d-613f-467b-b991-e01e961ff95f" released by "delete_volume" :: held 0.862s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:50:21 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-a7ae41c9-ddfe-4668-b15e-833087175063 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Created reservations ['0706adf8-1e4a-4388-8e22-7450c3e784b1', 'c8e73ae7-9024-4f3e-9441-709c1b0cc4e7', '96c113fb-6a0b-4339-85ec-a51c6a22a599', '18d5c11b-2743-4e01-a408-c74985ea6304'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:50:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a7ae41c9-ddfe-4668-b15e-833087175063 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a7ae41c9-ddfe-4668-b15e-833087175063 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a7ae41c9-ddfe-4668-b15e-833087175063 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a7ae41c9-ddfe-4668-b15e-833087175063 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a7ae41c9-ddfe-4668-b15e-833087175063 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a7ae41c9-ddfe-4668-b15e-833087175063 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:21 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:50:21 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:21 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-70c20c47-b049-4462-b88f-863cd048b77a tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "cinder-6e39ddd1-eab3-4c3d-80c6-b1487b9f8e73-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:50:21 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-70c20c47-b049-4462-b88f-863cd048b77a tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "cinder-6e39ddd1-eab3-4c3d-80c6-b1487b9f8e73-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:50:21 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-70c20c47-b049-4462-b88f-863cd048b77a tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "cinder-quobyte-6e39ddd1-eab3-4c3d-80c6-b1487b9f8e73" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-70c20c47-b049-4462-b88f-863cd048b77a tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "cinder-quobyte-6e39ddd1-eab3-4c3d-80c6-b1487b9f8e73" acquired by "delete_volume" :: waited 0.062s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0c4a11-db62-40a5-84ea-235996a7dab1]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-70c20c47-b049-4462-b88f-863cd048b77a tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6e39ddd1-eab3-4c3d-80c6-b1487b9f8e73 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:22 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a7ae41c9-ddfe-4668-b15e-833087175063 tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.468s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-a7ae41c9-ddfe-4668-b15e-833087175063 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:50:22 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-a7ae41c9-ddfe-4668-b15e-833087175063 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Deleted volume successfully. Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a7ae41c9-ddfe-4668-b15e-833087175063 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "cinder-c8f6a58d-613f-467b-b991-e01e961ff95f-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:50:22 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6e39ddd1-eab3-4c3d-80c6-b1487b9f8e73 Jul 17 19:50:22 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:22 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-70c20c47-b049-4462-b88f-863cd048b77a tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6e39ddd1-eab3-4c3d-80c6-b1487b9f8e73" returned: 0 in 0.542s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-70c20c47-b049-4462-b88f-863cd048b77a tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6e39ddd1-eab3-4c3d-80c6-b1487b9f8e73 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:22 devstack sudo[101612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6e39ddd1-eab3-4c3d-80c6-b1487b9f8e73 Jul 17 19:50:22 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] Flow 'volume_create_manager' (94ef0c68-2c1a-4011-af6b-02e3d334cf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d952c492-033c-4d7d-a856-bdc974a23457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d952c492-033c-4d7d-a856-bdc974a23457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-267017748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=212f70af-a8fa-4b3e-acd4-3b33a2947d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e22fdfc8fc54e2bb9c4effcfeace2a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:23Z,use_quota=True,user_id='22ca7302657e455d8824d7b6e75469a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(16e267fa-74bd-43e1-88d8-6b6087330964),volume_type_id=16e267fa-74bd-43e1-88d8-6b6087330964)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (533e64e7-5502-485a-b52d-514af774a61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (533e64e7-5502-485a-b52d-514af774a61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53cda68e-0e8e-4563-9d87-037de9c7764d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53cda68e-0e8e-4563-9d87-037de9c7764d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '212f70af-a8fa-4b3e-acd4-3b33a2947d91', 'volume_name': 'volume-212f70af-a8fa-4b3e-acd4-3b33a2947d91', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8601864-5540-4a7d-b79e-3de48ee14ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8601864-5540-4a7d-b79e-3de48ee14ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c40532d-23b5-4f13-88a3-88c010215336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:22 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] Volume 212f70af-a8fa-4b3e-acd4-3b33a2947d91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-212f70af-a8fa-4b3e-acd4-3b33a2947d91', 'volume_size': 1} Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-267017748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=212f70af-a8fa-4b3e-acd4-3b33a2947d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e22fdfc8fc54e2bb9c4effcfeace2a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:23Z,use_quota=True,user_id='22ca7302657e455d8824d7b6e75469a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(16e267fa-74bd-43e1-88d8-6b6087330964),volume_type_id=16e267fa-74bd-43e1-88d8-6b6087330964)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] Creating volume 212f70af-a8fa-4b3e-acd4-3b33a2947d91 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:50:22 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-212f70af-a8fa-4b3e-acd4-3b33a2947d91 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:22 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-212f70af-a8fa-4b3e-acd4-3b33a2947d91 1073741824 Jul 17 19:50:22 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:22 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-70c20c47-b049-4462-b88f-863cd048b77a tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6e39ddd1-eab3-4c3d-80c6-b1487b9f8e73" returned: 0 in 0.362s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-70c20c47-b049-4462-b88f-863cd048b77a tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "cinder-quobyte-6e39ddd1-eab3-4c3d-80c6-b1487b9f8e73" released by "delete_volume" :: held 1.012s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-70c20c47-b049-4462-b88f-863cd048b77a tempest-CreateVolumesFromSnapshotTest-1441430589 None] Created reservations ['7656cce3-fa8c-49e5-bd70-c5fcbec69f2a', 'e74991df-5459-4c21-a7fb-a145569535c4', '7b155d83-bb5d-48f8-964d-73c95f972f2e', '8bcca7aa-c305-412d-a6b5-6e84091e475f'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-70c20c47-b049-4462-b88f-863cd048b77a tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-70c20c47-b049-4462-b88f-863cd048b77a tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-70c20c47-b049-4462-b88f-863cd048b77a tempest-CreateVolumesFromSnapshotTest-1441430589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-70c20c47-b049-4462-b88f-863cd048b77a tempest-CreateVolumesFromSnapshotTest-1441430589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-70c20c47-b049-4462-b88f-863cd048b77a tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-70c20c47-b049-4462-b88f-863cd048b77a tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:50:23 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:50:23 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] Flow 'volume_create_manager' (82a67fc7-b0e1-4ee3-bfaa-b1aa8438445e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a00fb45-346a-4e53-ae5d-9ba451fc6f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a00fb45-346a-4e53-ae5d-9ba451fc6f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-864508950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8961794a-495c-44d3-9a62-20642ab3ce6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e22fdfc8fc54e2bb9c4effcfeace2a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:23Z,use_quota=True,user_id='22ca7302657e455d8824d7b6e75469a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2f6d152-01f6-4f1e-8517-3bf173e72740),volume_type_id=b2f6d152-01f6-4f1e-8517-3bf173e72740)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe29cac-7690-4888-97b8-74d55a5a6d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe29cac-7690-4888-97b8-74d55a5a6d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eacbd900-2264-420e-b601-d2370b363315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eacbd900-2264-420e-b601-d2370b363315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8961794a-495c-44d3-9a62-20642ab3ce6c', 'volume_name': 'volume-8961794a-495c-44d3-9a62-20642ab3ce6c', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d9deb87-5b23-4f7e-b96b-80c485d5a541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d9deb87-5b23-4f7e-b96b-80c485d5a541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf7e174-efff-4816-8d15-206655218932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:23 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] Volume 8961794a-495c-44d3-9a62-20642ab3ce6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8961794a-495c-44d3-9a62-20642ab3ce6c', 'volume_size': 1} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:23 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-212f70af-a8fa-4b3e-acd4-3b33a2947d91 1073741824" returned: 0 in 0.788s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:23 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-70c20c47-b049-4462-b88f-863cd048b77a tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.422s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-70c20c47-b049-4462-b88f-863cd048b77a tempest-CreateVolumesFromSnapshotTest-1441430589 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:50:23 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-70c20c47-b049-4462-b88f-863cd048b77a tempest-CreateVolumesFromSnapshotTest-1441430589 None] Deleted volume successfully. Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-212f70af-a8fa-4b3e-acd4-3b33a2947d91 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-70c20c47-b049-4462-b88f-863cd048b77a tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "cinder-6e39ddd1-eab3-4c3d-80c6-b1487b9f8e73-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:50:23 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-212f70af-a8fa-4b3e-acd4-3b33a2947d91 Jul 17 19:50:23 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:23 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-212f70af-a8fa-4b3e-acd4-3b33a2947d91" returned: 0 in 0.265s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.500s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-864508950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8961794a-495c-44d3-9a62-20642ab3ce6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e22fdfc8fc54e2bb9c4effcfeace2a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:23Z,use_quota=True,user_id='22ca7302657e455d8824d7b6e75469a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2f6d152-01f6-4f1e-8517-3bf173e72740),volume_type_id=b2f6d152-01f6-4f1e-8517-3bf173e72740)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] Creating volume 8961794a-495c-44d3-9a62-20642ab3ce6c {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:50:23 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8961794a-495c-44d3-9a62-20642ab3ce6c 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c40532d-23b5-4f13-88a3-88c010215336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-212f70af-a8fa-4b3e-acd4-3b33a2947d91', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e164cfaa-e7b8-4200-a770-ee4dbd725a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:24 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8961794a-495c-44d3-9a62-20642ab3ce6c 1073741824 Jul 17 19:50:24 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:24 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] Volume volume-212f70af-a8fa-4b3e-acd4-3b33a2947d91 (212f70af-a8fa-4b3e-acd4-3b33a2947d91): created successfully Jul 17 19:50:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e164cfaa-e7b8-4200-a770-ee4dbd725a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] Flow 'volume_create_manager' (94ef0c68-2c1a-4011-af6b-02e3d334cf9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:24 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:50:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Flow 'volume_create_manager' (4a253a81-5aba-4a6d-8b68-57718d9728e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bb59f01-0f73-4504-8816-cec41fe7731a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:24 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-d8dbf540-2498-47cc-a8df-feda08159c9d tempest-TestInstancesWithCinderVolumes-1339807416 None] Created volume successfully. Jul 17 19:50:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bb59f01-0f73-4504-8816-cec41fe7731a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1308822203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b853b5f-9273-432f-9338-c33acd74c3a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e22fdfc8fc54e2bb9c4effcfeace2a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:24Z,use_quota=True,user_id='22ca7302657e455d8824d7b6e75469a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(755c0f8a-d427-4a4f-b295-dc1e52a88276),volume_type_id=755c0f8a-d427-4a4f-b295-dc1e52a88276)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9293f5b-461d-4189-a130-51a5b2e12486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9293f5b-461d-4189-a130-51a5b2e12486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c79fcacc-647f-4089-af5f-4098cad3ed27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:24 devstack cinder-volume[87726]: DEBUG cinder.image.glance [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Creating Keystone auth plugin from conf {{(pid=87726) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 19:50:24 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ca9221bb-a005-45b8-8bbe-c76064d5dd8f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "cinder-785f7b35-0e5d-4408-bbe2-0a745970d8d4-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:50:24 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ca9221bb-a005-45b8-8bbe-c76064d5dd8f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "cinder-785f7b35-0e5d-4408-bbe2-0a745970d8d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:50:24 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ca9221bb-a005-45b8-8bbe-c76064d5dd8f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "cinder-quobyte-6b957c5a-db28-4d1a-b260-ce5265fc465e" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:50:24 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ca9221bb-a005-45b8-8bbe-c76064d5dd8f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "cinder-quobyte-6b957c5a-db28-4d1a-b260-ce5265fc465e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:50:24 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ca9221bb-a005-45b8-8bbe-c76064d5dd8f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "cinder-quobyte-785f7b35-0e5d-4408-bbe2-0a745970d8d4" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:50:24 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ca9221bb-a005-45b8-8bbe-c76064d5dd8f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "cinder-quobyte-785f7b35-0e5d-4408-bbe2-0a745970d8d4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:50:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-ca9221bb-a005-45b8-8bbe-c76064d5dd8f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Deleting offline snapshot 785f7b35-0e5d-4408-bbe2-0a745970d8d4 of volume 6b957c5a-db28-4d1a-b260-ce5265fc465e {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:50:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-ca9221bb-a005-45b8-8bbe-c76064d5dd8f tempest-CreateVolumesFromSnapshotTest-1441430589 None] snapshot_file for this snap is: volume-6b957c5a-db28-4d1a-b260-ce5265fc465e.785f7b35-0e5d-4408-bbe2-0a745970d8d4 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:50:24 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a18215-521b-4885-802b-753cc6cda861]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:50:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ca9221bb-a005-45b8-8bbe-c76064d5dd8f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e.785f7b35-0e5d-4408-bbe2-0a745970d8d4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:24 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e.785f7b35-0e5d-4408-bbe2-0a745970d8d4 Jul 17 19:50:24 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c79fcacc-647f-4089-af5f-4098cad3ed27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6b853b5f-9273-432f-9338-c33acd74c3a7', 'volume_name': 'volume-6b853b5f-9273-432f-9338-c33acd74c3a7', 'volume_size': 1, 'image_id': '4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--4566619', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e22fdfc8fc54e2bb9c4effcfeace2a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6', 'created_at': datetime.datetime(2026, 7, 17, 17, 50, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 17, 50, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6/file', 'properties': {}}, 'image_service': }' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ea9eb0-4df1-4558-87be-07c0b333c72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:24 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ea9eb0-4df1-4558-87be-07c0b333c72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4035aa83-0f1b-488f-9743-edcb73446e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:24 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Volume 6b853b5f-9273-432f-9338-c33acd74c3a7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6b853b5f-9273-432f-9338-c33acd74c3a7', 'volume_size': 1, 'image_id': '4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--4566619', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e22fdfc8fc54e2bb9c4effcfeace2a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6', 'created_at': datetime.datetime(2026, 7, 17, 17, 50, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 17, 50, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6/file', 'properties': {}}, 'image_service': } Jul 17 19:50:24 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Trying to clone 6b853b5f-9273-432f-9338-c33acd74c3a7 from image 4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6', 'metadata': {}}]). {{(pid=87726) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 19:50:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8961794a-495c-44d3-9a62-20642ab3ce6c 1073741824" returned: 0 in 0.787s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8961794a-495c-44d3-9a62-20642ab3ce6c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:24 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8961794a-495c-44d3-9a62-20642ab3ce6c Jul 17 19:50:24 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:25 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ca9221bb-a005-45b8-8bbe-c76064d5dd8f tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e.785f7b35-0e5d-4408-bbe2-0a745970d8d4" returned: 0 in 0.841s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-ca9221bb-a005-45b8-8bbe-c76064d5dd8f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b957c5a-db28-4d1a-b260-ce5265fc465e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:50:25 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2311cf-00d1-444d-97cb-c69a748e70d2]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:50:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ca9221bb-a005-45b8-8bbe-c76064d5dd8f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:25 devstack sudo[101702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e Jul 17 19:50:25 devstack sudo[101702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:25 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8961794a-495c-44d3-9a62-20642ab3ce6c" returned: 0 in 0.755s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:50:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf7e174-efff-4816-8d15-206655218932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8961794a-495c-44d3-9a62-20642ab3ce6c', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f284094c-2c0e-4d4d-a0b7-9466634ab069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:25 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] Volume volume-8961794a-495c-44d3-9a62-20642ab3ce6c (8961794a-495c-44d3-9a62-20642ab3ce6c): created successfully Jul 17 19:50:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f284094c-2c0e-4d4d-a0b7-9466634ab069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] Flow 'volume_create_manager' (82a67fc7-b0e1-4ee3-bfaa-b1aa8438445e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:25 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-ef9fb52b-23e7-44da-82f2-0a645e061599 tempest-TestInstancesWithCinderVolumes-1339807416 None] Created volume successfully. Jul 17 19:50:25 devstack sudo[101702]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ca9221bb-a005-45b8-8bbe-c76064d5dd8f tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e" returned: 0 in 0.605s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ca9221bb-a005-45b8-8bbe-c76064d5dd8f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e.785f7b35-0e5d-4408-bbe2-0a745970d8d4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:25 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e.785f7b35-0e5d-4408-bbe2-0a745970d8d4 Jul 17 19:50:25 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:26 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ca9221bb-a005-45b8-8bbe-c76064d5dd8f tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e.785f7b35-0e5d-4408-bbe2-0a745970d8d4" returned: 0 in 0.560s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ca9221bb-a005-45b8-8bbe-c76064d5dd8f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e.785f7b35-0e5d-4408-bbe2-0a745970d8d4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:26 devstack sudo[101723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e.785f7b35-0e5d-4408-bbe2-0a745970d8d4 Jul 17 19:50:26 devstack sudo[101723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:26 devstack sudo[101723]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ca9221bb-a005-45b8-8bbe-c76064d5dd8f tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e.785f7b35-0e5d-4408-bbe2-0a745970d8d4" returned: 0 in 0.387s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ca9221bb-a005-45b8-8bbe-c76064d5dd8f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "cinder-quobyte-785f7b35-0e5d-4408-bbe2-0a745970d8d4" released by "_delete_snapshot" :: held 2.574s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:50:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ca9221bb-a005-45b8-8bbe-c76064d5dd8f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "cinder-quobyte-6b957c5a-db28-4d1a-b260-ce5265fc465e" released by "delete_snapshot" :: held 2.604s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:50:26 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-ca9221bb-a005-45b8-8bbe-c76064d5dd8f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Created reservations ['2ac2e2a3-cd33-4822-a9f1-e79f60ec3084', 'b2598ddd-ea87-4603-ac8c-e85c66201056', 'efbd1d79-f6b9-4663-a1b7-1bc213351766', '8fbaa6ac-7c3c-41b9-838e-9abfcb97a45d'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:50:27 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-ca9221bb-a005-45b8-8bbe-c76064d5dd8f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Delete snapshot completed successfully. Jul 17 19:50:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ca9221bb-a005-45b8-8bbe-c76064d5dd8f tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "cinder-785f7b35-0e5d-4408-bbe2-0a745970d8d4-delete_snapshot" released by "delete_snapshot" :: held 2.790s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:50:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a33be994-c5ef-4aff-9f5c-6889d32a1d60 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "cinder-6b957c5a-db28-4d1a-b260-ce5265fc465e-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:50:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a33be994-c5ef-4aff-9f5c-6889d32a1d60 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "cinder-6b957c5a-db28-4d1a-b260-ce5265fc465e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:50:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a33be994-c5ef-4aff-9f5c-6889d32a1d60 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "cinder-quobyte-6b957c5a-db28-4d1a-b260-ce5265fc465e" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:50:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a33be994-c5ef-4aff-9f5c-6889d32a1d60 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "cinder-quobyte-6b957c5a-db28-4d1a-b260-ce5265fc465e" acquired by "delete_volume" :: waited 0.019s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:50:27 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7b835d-1ec6-4ea5-a3ab-7baf762013d8]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:50:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a33be994-c5ef-4aff-9f5c-6889d32a1d60 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:27 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e Jul 17 19:50:27 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:28 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a33be994-c5ef-4aff-9f5c-6889d32a1d60 tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e" returned: 0 in 0.398s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a33be994-c5ef-4aff-9f5c-6889d32a1d60 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:28 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e Jul 17 19:50:28 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:28 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a33be994-c5ef-4aff-9f5c-6889d32a1d60 tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b957c5a-db28-4d1a-b260-ce5265fc465e" returned: 0 in 0.359s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a33be994-c5ef-4aff-9f5c-6889d32a1d60 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "cinder-quobyte-6b957c5a-db28-4d1a-b260-ce5265fc465e" released by "delete_volume" :: held 0.838s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:50:28 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-a33be994-c5ef-4aff-9f5c-6889d32a1d60 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Created reservations ['14ad2937-f010-4432-91fd-ad03b2d12879', 'cb0ae298-cef1-4a78-9635-b34983658ea5', '2cf0b84e-be17-44da-99a8-79f694b2bfcb', '06d26852-43d0-4583-a69d-e6a1282662e1'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:50:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a33be994-c5ef-4aff-9f5c-6889d32a1d60 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a33be994-c5ef-4aff-9f5c-6889d32a1d60 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a33be994-c5ef-4aff-9f5c-6889d32a1d60 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a33be994-c5ef-4aff-9f5c-6889d32a1d60 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a33be994-c5ef-4aff-9f5c-6889d32a1d60 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a33be994-c5ef-4aff-9f5c-6889d32a1d60 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:28 devstack sudo[101734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:50:28 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:29 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a33be994-c5ef-4aff-9f5c-6889d32a1d60 tempest-CreateVolumesFromSnapshotTest-1441430589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.509s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:29 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-a33be994-c5ef-4aff-9f5c-6889d32a1d60 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:50:29 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-a33be994-c5ef-4aff-9f5c-6889d32a1d60 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Deleted volume successfully. Jul 17 19:50:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a33be994-c5ef-4aff-9f5c-6889d32a1d60 tempest-CreateVolumesFromSnapshotTest-1441430589 None] Lock "cinder-6b957c5a-db28-4d1a-b260-ce5265fc465e-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:50:30 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6_9txwfi1ndevstack@QuobyteHD, size 20.69 MB, duration 5.39 sec {{(pid=87726) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 19:50:30 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Image download 20.69 MB at 3.84 MB/s Jul 17 19:50:30 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21ad574-82a9-4efc-b1cb-81c8383d1973]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:50:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6_9txwfi1ndevstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:30 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6_9txwfi1ndevstack@QuobyteHD Jul 17 19:50:30 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:30 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6_9txwfi1ndevstack@QuobyteHD" returned: 0 in 0.502s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:30 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Temporary image 4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6 is fetched for user 22ca7302657e455d8824d7b6e75469a8. {{(pid=87726) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 19:50:30 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d47515-06df-4576-a5b7-170394a37f28]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:50:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6_9txwfi1ndevstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:30 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6_9txwfi1ndevstack@QuobyteHD Jul 17 19:50:30 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:31 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6_9txwfi1ndevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1308822203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b853b5f-9273-432f-9338-c33acd74c3a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e22fdfc8fc54e2bb9c4effcfeace2a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:24Z,use_quota=True,user_id='22ca7302657e455d8824d7b6e75469a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(755c0f8a-d427-4a4f-b295-dc1e52a88276),volume_type_id=755c0f8a-d427-4a4f-b295-dc1e52a88276)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:50:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Creating volume 6b853b5f-9273-432f-9338-c33acd74c3a7 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:50:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:50:31 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:50:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b853b5f-9273-432f-9338-c33acd74c3a7 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:31 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b853b5f-9273-432f-9338-c33acd74c3a7 1073741824 Jul 17 19:50:31 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:31 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b853b5f-9273-432f-9338-c33acd74c3a7 1073741824" returned: 0 in 0.651s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b853b5f-9273-432f-9338-c33acd74c3a7 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:32 devstack sudo[101757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b853b5f-9273-432f-9338-c33acd74c3a7 Jul 17 19:50:32 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:32 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b853b5f-9273-432f-9338-c33acd74c3a7" returned: 0 in 0.310s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:32 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:50:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:32 devstack cinder-volume[87726]: DEBUG cinder.volume.volume_utils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Attempting download of 4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6', 'metadata': {}}])) to volume 6b853b5f-9273-432f-9338-c33acd74c3a7. {{(pid=87726) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 19:50:32 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fceeb4-9a68-4a72-83d8-a0e266369509]: (4, 'raw') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:50:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6_ot74f1yh {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:32 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6_ot74f1yh Jul 17 19:50:32 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:32 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:50:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Flow 'volume_create_manager' (88e0bf9a-5520-4d50-998d-7e632c684bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdda4b5c-7e54-499f-8b6b-213cc719eac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdda4b5c-7e54-499f-8b6b-213cc719eac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-43774866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d14024c-f5f4-4229-a80d-01065986fbf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93757f73df8404eae5a9481e201f2f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:33Z,use_quota=True,user_id='e6dc4092cb874866a874953174bce99f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea864eb4-e490-4d70-be7d-d7633a0b7304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea864eb4-e490-4d70-be7d-d7633a0b7304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e5e6da-20ff-41f1-b687-e873fd2a866a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e5e6da-20ff-41f1-b687-e873fd2a866a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d14024c-f5f4-4229-a80d-01065986fbf7', 'volume_name': 'volume-6d14024c-f5f4-4229-a80d-01065986fbf7', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44cb1110-458a-4437-9145-fa89b61ca688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44cb1110-458a-4437-9145-fa89b61ca688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe37d9ca-f6fe-42e0-9514-fb64849c905e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:32 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Volume 6d14024c-f5f4-4229-a80d-01065986fbf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d14024c-f5f4-4229-a80d-01065986fbf7', 'volume_size': 1} Jul 17 19:50:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:32 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-43774866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d14024c-f5f4-4229-a80d-01065986fbf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93757f73df8404eae5a9481e201f2f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:33Z,use_quota=True,user_id='e6dc4092cb874866a874953174bce99f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:50:32 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Creating volume 6d14024c-f5f4-4229-a80d-01065986fbf7 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:50:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:32 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:32 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:32 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:50:32 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:50:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6d14024c-f5f4-4229-a80d-01065986fbf7 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:32 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6d14024c-f5f4-4229-a80d-01065986fbf7 1073741824 Jul 17 19:50:32 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:32 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6_ot74f1yh" returned: 0 in 0.418s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6_ot74f1yh {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:32 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6_ot74f1yh Jul 17 19:50:32 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:33 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6d14024c-f5f4-4229-a80d-01065986fbf7 1073741824" returned: 0 in 0.418s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:33 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6_ot74f1yh" returned: 1 in 0.350s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6_ot74f1yh' failed. Not Retrying. {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 19:50:33 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9a1e87-5586-4591-beee-7eca9c143b2a]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:50:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6_9txwfi1ndevstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6d14024c-f5f4-4229-a80d-01065986fbf7 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:33 devstack sudo[101776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6d14024c-f5f4-4229-a80d-01065986fbf7 Jul 17 19:50:33 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:33 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6_9txwfi1ndevstack@QuobyteHD Jul 17 19:50:33 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:33 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6d14024c-f5f4-4229-a80d-01065986fbf7" returned: 0 in 0.251s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:50:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe37d9ca-f6fe-42e0-9514-fb64849c905e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d14024c-f5f4-4229-a80d-01065986fbf7', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (924d65d9-b6b3-4a72-9a34-58ca79632be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:33 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Volume volume-6d14024c-f5f4-4229-a80d-01065986fbf7 (6d14024c-f5f4-4229-a80d-01065986fbf7): created successfully Jul 17 19:50:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (924d65d9-b6b3-4a72-9a34-58ca79632be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Flow 'volume_create_manager' (88e0bf9a-5520-4d50-998d-7e632c684bc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:33 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-b44cfd11-0836-4a0a-8937-6333762c341e tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Created volume successfully. Jul 17 19:50:33 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6_9txwfi1ndevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:33 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] 4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6 was qcow2, converting to qcow2 {{(pid=87726) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 19:50:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6_9txwfi1ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b853b5f-9273-432f-9338-c33acd74c3a7 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:33 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6_9txwfi1ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b853b5f-9273-432f-9338-c33acd74c3a7 Jul 17 19:50:33 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Flow 'volume_create_manager' (7bf6a27b-6867-40f3-a166-2f32e0ad7e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (456802e2-06aa-4098-b2cf-f52f100066c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (456802e2-06aa-4098-b2cf-f52f100066c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1433987316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63515b6d-a80f-4c8e-a034-4521f0e6b754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93757f73df8404eae5a9481e201f2f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:34Z,use_quota=True,user_id='e6dc4092cb874866a874953174bce99f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9524b28-dec7-49c6-867f-b413ff69cf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9524b28-dec7-49c6-867f-b413ff69cf1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f0002d-92ff-4384-9981-30b4ebe51558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f0002d-92ff-4384-9981-30b4ebe51558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63515b6d-a80f-4c8e-a034-4521f0e6b754', 'volume_name': 'volume-63515b6d-a80f-4c8e-a034-4521f0e6b754', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3adc7ca8-d89f-4642-9c29-d9f83862562c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3adc7ca8-d89f-4642-9c29-d9f83862562c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49151fa-db5f-435a-bdb2-488249035821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:34 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Volume 63515b6d-a80f-4c8e-a034-4521f0e6b754: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63515b6d-a80f-4c8e-a034-4521f0e6b754', 'volume_size': 1} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1433987316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63515b6d-a80f-4c8e-a034-4521f0e6b754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93757f73df8404eae5a9481e201f2f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:34Z,use_quota=True,user_id='e6dc4092cb874866a874953174bce99f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Creating volume 63515b6d-a80f-4c8e-a034-4521f0e6b754 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:50:34 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-63515b6d-a80f-4c8e-a034-4521f0e6b754 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:34 devstack sudo[101790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-63515b6d-a80f-4c8e-a034-4521f0e6b754 1073741824 Jul 17 19:50:34 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Flow 'volume_create_manager' (9538f429-b30a-45fe-abfc-4c393c903bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b95e19-21e8-4c0e-be71-03097349c495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b95e19-21e8-4c0e-be71-03097349c495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1818332250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3fb7537-1b66-4235-b617-ad5d87a29f98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93757f73df8404eae5a9481e201f2f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:35Z,use_quota=True,user_id='e6dc4092cb874866a874953174bce99f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e38502e-2e58-406e-9e5e-f2f3c662d385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e38502e-2e58-406e-9e5e-f2f3c662d385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46072cd5-fbed-413f-962d-57ad17253028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46072cd5-fbed-413f-962d-57ad17253028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3fb7537-1b66-4235-b617-ad5d87a29f98', 'volume_name': 'volume-a3fb7537-1b66-4235-b617-ad5d87a29f98', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f11ab71-a921-4698-94e0-c915d915af6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f11ab71-a921-4698-94e0-c915d915af6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05be2d8c-fb92-4054-95b0-4522632606fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:34 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Volume a3fb7537-1b66-4235-b617-ad5d87a29f98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3fb7537-1b66-4235-b617-ad5d87a29f98', 'volume_size': 1} Jul 17 19:50:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:35 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-63515b6d-a80f-4c8e-a034-4521f0e6b754 1073741824" returned: 0 in 0.702s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-63515b6d-a80f-4c8e-a034-4521f0e6b754 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:35 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-63515b6d-a80f-4c8e-a034-4521f0e6b754 Jul 17 19:50:35 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Flow 'volume_create_manager' (8fa6c3a2-2cb2-4e60-8a63-3d79a033b122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5749dc82-0caf-4990-b799-32d95322f0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5749dc82-0caf-4990-b799-32d95322f0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-73454673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04c09bc8-6fd0-47cf-8caa-409284a5d56c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93757f73df8404eae5a9481e201f2f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:35Z,use_quota=True,user_id='e6dc4092cb874866a874953174bce99f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (823dcf2f-61ec-4b58-ab59-159a1fe66a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (823dcf2f-61ec-4b58-ab59-159a1fe66a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:35 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1e2024-6d90-4718-bab7-aadc1431949a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1e2024-6d90-4718-bab7-aadc1431949a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04c09bc8-6fd0-47cf-8caa-409284a5d56c', 'volume_name': 'volume-04c09bc8-6fd0-47cf-8caa-409284a5d56c', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f42f7b3-37a0-4431-a943-616fd9d5f7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f42f7b3-37a0-4431-a943-616fd9d5f7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581cfcb1-02b6-4c8d-bc9f-59c07789ded6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:35 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Volume 04c09bc8-6fd0-47cf-8caa-409284a5d56c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04c09bc8-6fd0-47cf-8caa-409284a5d56c', 'volume_size': 1} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-63515b6d-a80f-4c8e-a034-4521f0e6b754" returned: 0 in 0.425s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.660s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1818332250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3fb7537-1b66-4235-b617-ad5d87a29f98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93757f73df8404eae5a9481e201f2f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:35Z,use_quota=True,user_id='e6dc4092cb874866a874953174bce99f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Creating volume a3fb7537-1b66-4235-b617-ad5d87a29f98 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:50:35 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a3fb7537-1b66-4235-b617-ad5d87a29f98 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49151fa-db5f-435a-bdb2-488249035821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63515b6d-a80f-4c8e-a034-4521f0e6b754', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ca5653-8501-487e-9bd4-f0c349cf53a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:35 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a3fb7537-1b66-4235-b617-ad5d87a29f98 1073741824 Jul 17 19:50:35 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:35 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Volume volume-63515b6d-a80f-4c8e-a034-4521f0e6b754 (63515b6d-a80f-4c8e-a034-4521f0e6b754): created successfully Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ca5653-8501-487e-9bd4-f0c349cf53a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Flow 'volume_create_manager' (7bf6a27b-6867-40f3-a166-2f32e0ad7e61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:35 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-309d8ceb-3494-413c-8a19-caeb53758ed1 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Created volume successfully. Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Flow 'volume_create_manager' (e64d3ca4-26f7-4bad-a57e-84f375b76cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5079cc0-b908-47bf-ba8b-93182b1672e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5079cc0-b908-47bf-ba8b-93182b1672e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1709161601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b688f426-9aef-47b8-9d15-dfabee2168ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93757f73df8404eae5a9481e201f2f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:36Z,use_quota=True,user_id='e6dc4092cb874866a874953174bce99f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6c62af8-c18c-47f0-b5b7-6478d91f8787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6c62af8-c18c-47f0-b5b7-6478d91f8787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4a5700-2faf-40bb-ba6d-bd26e7275993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4a5700-2faf-40bb-ba6d-bd26e7275993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b688f426-9aef-47b8-9d15-dfabee2168ea', 'volume_name': 'volume-b688f426-9aef-47b8-9d15-dfabee2168ea', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca739863-6e3b-4d27-af7d-8ee59399844a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca739863-6e3b-4d27-af7d-8ee59399844a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (789f24c3-09f0-402e-a6c9-582b5a869857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:35 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Volume b688f426-9aef-47b8-9d15-dfabee2168ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b688f426-9aef-47b8-9d15-dfabee2168ea', 'volume_size': 1} Jul 17 19:50:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:35 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6_9txwfi1ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b853b5f-9273-432f-9338-c33acd74c3a7" returned: 0 in 2.451s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6_9txwfi1ndevstack@QuobyteHD, size 112.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b853b5f-9273-432f-9338-c33acd74c3a7 {{(pid=87726) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 19:50:36 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Converted 112.00 MB image at 45.68 MB/s Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b853b5f-9273-432f-9338-c33acd74c3a7 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:36 devstack sudo[101803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b853b5f-9273-432f-9338-c33acd74c3a7 1G Jul 17 19:50:36 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:36 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a3fb7537-1b66-4235-b617-ad5d87a29f98 1073741824" returned: 0 in 0.691s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a3fb7537-1b66-4235-b617-ad5d87a29f98 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:36 devstack sudo[101808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a3fb7537-1b66-4235-b617-ad5d87a29f98 Jul 17 19:50:36 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:36 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b853b5f-9273-432f-9338-c33acd74c3a7 1G" returned: 0 in 0.427s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.volume.volume_utils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Downloaded image 4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6', 'metadata': {}}])) to volume 6b853b5f-9273-432f-9338-c33acd74c3a7 successfully. {{(pid=87726) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Temporary image 4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6 for user 22ca7302657e455d8824d7b6e75469a8 is deleted. {{(pid=87726) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.volume.volume_utils [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Marking volume 6b853b5f-9273-432f-9338-c33acd74c3a7 as bootable. {{(pid=87726) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Copying metadata from image 4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6 to 6b853b5f-9273-432f-9338-c33acd74c3a7. {{(pid=87726) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Creating volume glance metadata for volume 6b853b5f-9273-432f-9338-c33acd74c3a7 backed by image 4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6 with: {'image_id': '4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6', 'image_name': 'tempest-scenario-img--4566619', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87726) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4035aa83-0f1b-488f-9743-edcb73446e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b853b5f-9273-432f-9338-c33acd74c3a7', 'volume_size': 1, 'image_id': '4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--4566619', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e22fdfc8fc54e2bb9c4effcfeace2a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6', 'created_at': datetime.datetime(2026, 7, 17, 17, 50, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 17, 50, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ba08fa2-dc8a-4746-b4ca-a8e3705c94e6/file', 'properties': {}}, 'image_service': }' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b95f0b4-4eba-425b-8176-be67f184b8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:36 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Volume volume-6b853b5f-9273-432f-9338-c33acd74c3a7 (6b853b5f-9273-432f-9338-c33acd74c3a7): created successfully Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b95f0b4-4eba-425b-8176-be67f184b8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Flow 'volume_create_manager' (4a253a81-5aba-4a6d-8b68-57718d9728e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Flow 'volume_create_manager' (5a58cd89-10fa-45a6-ad95-27a4fdc7630a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:36 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512cd0d6-f71b-4b58-9a72-c56cd5e3fd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a3fb7537-1b66-4235-b617-ad5d87a29f98" returned: 0 in 0.409s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:36 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e3186979-83a5-420e-9923-05c9dbd316ef tempest-TestInstancesWithCinderVolumes-1339807416 None] Created volume successfully. Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.190s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-73454673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04c09bc8-6fd0-47cf-8caa-409284a5d56c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93757f73df8404eae5a9481e201f2f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:35Z,use_quota=True,user_id='e6dc4092cb874866a874953174bce99f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Creating volume 04c09bc8-6fd0-47cf-8caa-409284a5d56c {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:50:36 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-04c09bc8-6fd0-47cf-8caa-409284a5d56c 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512cd0d6-f71b-4b58-9a72-c56cd5e3fd28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1747471446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d22e56b5-67ba-4827-80e9-15e96a85e0a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93757f73df8404eae5a9481e201f2f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:37Z,use_quota=True,user_id='e6dc4092cb874866a874953174bce99f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f030efa-646a-4ff9-9f12-b85c8b31dafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:36 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-04c09bc8-6fd0-47cf-8caa-409284a5d56c 1073741824 Jul 17 19:50:36 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f030efa-646a-4ff9-9f12-b85c8b31dafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd80cb93-36a5-41dd-a012-b62c38447691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd80cb93-36a5-41dd-a012-b62c38447691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd22e56b5-67ba-4827-80e9-15e96a85e0a3', 'volume_name': 'volume-d22e56b5-67ba-4827-80e9-15e96a85e0a3', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59fc4d5b-258d-460b-902c-a077961ee36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59fc4d5b-258d-460b-902c-a077961ee36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (486a9117-aeee-41a0-b10a-0cd748c34dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:36 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Volume d22e56b5-67ba-4827-80e9-15e96a85e0a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d22e56b5-67ba-4827-80e9-15e96a85e0a3', 'volume_size': 1} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05be2d8c-fb92-4054-95b0-4522632606fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3fb7537-1b66-4235-b617-ad5d87a29f98', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bfdc681-b077-4130-bbad-c46fd9114397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:36 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Volume volume-a3fb7537-1b66-4235-b617-ad5d87a29f98 (a3fb7537-1b66-4235-b617-ad5d87a29f98): created successfully Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bfdc681-b077-4130-bbad-c46fd9114397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Flow 'volume_create_manager' (9538f429-b30a-45fe-abfc-4c393c903bd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:36 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-37b24470-4897-4c8d-97c7-991df82eee43 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Created volume successfully. Jul 17 19:50:37 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-04c09bc8-6fd0-47cf-8caa-409284a5d56c 1073741824" returned: 0 in 0.497s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-04c09bc8-6fd0-47cf-8caa-409284a5d56c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:37 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-04c09bc8-6fd0-47cf-8caa-409284a5d56c Jul 17 19:50:37 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:37 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-04c09bc8-6fd0-47cf-8caa-409284a5d56c" returned: 0 in 0.252s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:50:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.585s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1709161601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b688f426-9aef-47b8-9d15-dfabee2168ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93757f73df8404eae5a9481e201f2f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:36Z,use_quota=True,user_id='e6dc4092cb874866a874953174bce99f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:50:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Creating volume b688f426-9aef-47b8-9d15-dfabee2168ea {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:50:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:50:37 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:50:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b688f426-9aef-47b8-9d15-dfabee2168ea 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:37 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b688f426-9aef-47b8-9d15-dfabee2168ea 1073741824 Jul 17 19:50:37 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581cfcb1-02b6-4c8d-bc9f-59c07789ded6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04c09bc8-6fd0-47cf-8caa-409284a5d56c', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (384da8a3-986a-4bef-9efe-b5bcfe485103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:37 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Volume volume-04c09bc8-6fd0-47cf-8caa-409284a5d56c (04c09bc8-6fd0-47cf-8caa-409284a5d56c): created successfully Jul 17 19:50:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (384da8a3-986a-4bef-9efe-b5bcfe485103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Flow 'volume_create_manager' (8fa6c3a2-2cb2-4e60-8a63-3d79a033b122) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:37 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-7a3fa3dd-7486-4f2b-8201-6d439f744b92 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Created volume successfully. Jul 17 19:50:38 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b688f426-9aef-47b8-9d15-dfabee2168ea 1073741824" returned: 0 in 0.604s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b688f426-9aef-47b8-9d15-dfabee2168ea {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:38 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b688f426-9aef-47b8-9d15-dfabee2168ea Jul 17 19:50:38 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:38 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b688f426-9aef-47b8-9d15-dfabee2168ea" returned: 0 in 0.294s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:38 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:50:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.692s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:38 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1747471446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d22e56b5-67ba-4827-80e9-15e96a85e0a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93757f73df8404eae5a9481e201f2f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:37Z,use_quota=True,user_id='e6dc4092cb874866a874953174bce99f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:50:38 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Creating volume d22e56b5-67ba-4827-80e9-15e96a85e0a3 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:50:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:38 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:38 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:38 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:50:38 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:50:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d22e56b5-67ba-4827-80e9-15e96a85e0a3 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (789f24c3-09f0-402e-a6c9-582b5a869857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b688f426-9aef-47b8-9d15-dfabee2168ea', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab878928-077e-4632-a2ec-33d69033a556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:38 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d22e56b5-67ba-4827-80e9-15e96a85e0a3 1073741824 Jul 17 19:50:38 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:38 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Volume volume-b688f426-9aef-47b8-9d15-dfabee2168ea (b688f426-9aef-47b8-9d15-dfabee2168ea): created successfully Jul 17 19:50:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab878928-077e-4632-a2ec-33d69033a556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Flow 'volume_create_manager' (e64d3ca4-26f7-4bad-a57e-84f375b76cb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:38 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-b45a5a05-c34a-49dd-ac21-f83870001f42 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Created volume successfully. Jul 17 19:50:39 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d22e56b5-67ba-4827-80e9-15e96a85e0a3 1073741824" returned: 0 in 0.623s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d22e56b5-67ba-4827-80e9-15e96a85e0a3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:39 devstack sudo[101856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d22e56b5-67ba-4827-80e9-15e96a85e0a3 Jul 17 19:50:39 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:39 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d22e56b5-67ba-4827-80e9-15e96a85e0a3" returned: 0 in 0.277s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:39 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:50:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:39 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (486a9117-aeee-41a0-b10a-0cd748c34dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d22e56b5-67ba-4827-80e9-15e96a85e0a3', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:39 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ae3b95-7b16-4f96-81ea-135ed7d556a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:39 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Volume volume-d22e56b5-67ba-4827-80e9-15e96a85e0a3 (d22e56b5-67ba-4827-80e9-15e96a85e0a3): created successfully Jul 17 19:50:39 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ae3b95-7b16-4f96-81ea-135ed7d556a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:39 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Flow 'volume_create_manager' (5a58cd89-10fa-45a6-ad95-27a4fdc7630a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:39 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-1d6440df-c4ff-49df-a249-8380148e7c98 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Created volume successfully. Jul 17 19:50:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-2262a68f-95ce-48cf-bb1b-6410cf55deaa req-796be598-3cba-4a48-ad47-462bdd7dd1f1 tempest-TestInstancesWithCinderVolumes-1339807416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-2262a68f-95ce-48cf-bb1b-6410cf55deaa req-796be598-3cba-4a48-ad47-462bdd7dd1f1 tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-2262a68f-95ce-48cf-bb1b-6410cf55deaa req-796be598-3cba-4a48-ad47-462bdd7dd1f1 tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:40 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-2262a68f-95ce-48cf-bb1b-6410cf55deaa req-796be598-3cba-4a48-ad47-462bdd7dd1f1 tempest-TestInstancesWithCinderVolumes-1339807416 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55', 'name': 'volume-6b853b5f-9273-432f-9338-c33acd74c3a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8413f568-93e1-49d6-9fd9-1f2a1e412f41', 'enforce_multipath': True} {{(pid=87726) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 19:50:40 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6c3d7853-20db-400f-be4a-e5984554b250 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Acquiring lock "cinder-d22e56b5-67ba-4827-80e9-15e96a85e0a3-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:50:40 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-2262a68f-95ce-48cf-bb1b-6410cf55deaa req-796be598-3cba-4a48-ad47-462bdd7dd1f1 tempest-TestInstancesWithCinderVolumes-1339807416 None] attachment_update completed successfully. Jul 17 19:50:40 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6c3d7853-20db-400f-be4a-e5984554b250 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "cinder-d22e56b5-67ba-4827-80e9-15e96a85e0a3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:50:40 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6c3d7853-20db-400f-be4a-e5984554b250 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Acquiring lock "cinder-quobyte-d22e56b5-67ba-4827-80e9-15e96a85e0a3" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:50:40 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6c3d7853-20db-400f-be4a-e5984554b250 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "cinder-quobyte-d22e56b5-67ba-4827-80e9-15e96a85e0a3" acquired by "delete_volume" :: waited 0.033s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:50:40 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[60daa9e8-a91b-48e0-9206-489f9ef338a6]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:50:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6c3d7853-20db-400f-be4a-e5984554b250 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d22e56b5-67ba-4827-80e9-15e96a85e0a3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:40 devstack sudo[101868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d22e56b5-67ba-4827-80e9-15e96a85e0a3 Jul 17 19:50:40 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:40 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6c3d7853-20db-400f-be4a-e5984554b250 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d22e56b5-67ba-4827-80e9-15e96a85e0a3" returned: 0 in 0.428s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6c3d7853-20db-400f-be4a-e5984554b250 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d22e56b5-67ba-4827-80e9-15e96a85e0a3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:40 devstack sudo[101873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d22e56b5-67ba-4827-80e9-15e96a85e0a3 Jul 17 19:50:40 devstack sudo[101873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:41 devstack sudo[101873]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6c3d7853-20db-400f-be4a-e5984554b250 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d22e56b5-67ba-4827-80e9-15e96a85e0a3" returned: 0 in 0.260s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:41 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6c3d7853-20db-400f-be4a-e5984554b250 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "cinder-quobyte-d22e56b5-67ba-4827-80e9-15e96a85e0a3" released by "delete_volume" :: held 0.755s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:50:41 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-6c3d7853-20db-400f-be4a-e5984554b250 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Created reservations ['76525d39-dfc3-467a-aac3-e41aef9f4830', '22538528-d2c0-4ee0-948f-12a382a12880', 'e48d39bb-b70e-45d3-9a66-2deb9ef2280e', 'ad35f9c4-ca0f-412e-a93d-b58fa3332dce'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:50:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6c3d7853-20db-400f-be4a-e5984554b250 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6c3d7853-20db-400f-be4a-e5984554b250 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:41 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6c3d7853-20db-400f-be4a-e5984554b250 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:41 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6c3d7853-20db-400f-be4a-e5984554b250 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6c3d7853-20db-400f-be4a-e5984554b250 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6c3d7853-20db-400f-be4a-e5984554b250 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:41 devstack sudo[101876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:50:41 devstack sudo[101876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:41 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1503af56-04b4-42f9-a72f-93838096a814 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Acquiring lock "cinder-b688f426-9aef-47b8-9d15-dfabee2168ea-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:50:41 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1503af56-04b4-42f9-a72f-93838096a814 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "cinder-b688f426-9aef-47b8-9d15-dfabee2168ea-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:50:41 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1503af56-04b4-42f9-a72f-93838096a814 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Acquiring lock "cinder-quobyte-b688f426-9aef-47b8-9d15-dfabee2168ea" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:50:41 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1503af56-04b4-42f9-a72f-93838096a814 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "cinder-quobyte-b688f426-9aef-47b8-9d15-dfabee2168ea" acquired by "delete_volume" :: waited 0.020s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:50:41 devstack sudo[101876]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6c3d7853-20db-400f-be4a-e5984554b250 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.282s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:41 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-6c3d7853-20db-400f-be4a-e5984554b250 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:50:41 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[243261d5-4fa4-431a-acfe-2ab3ee82eb7c]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:50:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1503af56-04b4-42f9-a72f-93838096a814 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b688f426-9aef-47b8-9d15-dfabee2168ea {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:41 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-6c3d7853-20db-400f-be4a-e5984554b250 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Deleted volume successfully. Jul 17 19:50:41 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6c3d7853-20db-400f-be4a-e5984554b250 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "cinder-d22e56b5-67ba-4827-80e9-15e96a85e0a3-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:50:41 devstack sudo[101879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b688f426-9aef-47b8-9d15-dfabee2168ea Jul 17 19:50:41 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:41 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1503af56-04b4-42f9-a72f-93838096a814 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b688f426-9aef-47b8-9d15-dfabee2168ea" returned: 0 in 0.380s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1503af56-04b4-42f9-a72f-93838096a814 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b688f426-9aef-47b8-9d15-dfabee2168ea {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:41 devstack sudo[101885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b688f426-9aef-47b8-9d15-dfabee2168ea Jul 17 19:50:41 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:42 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1503af56-04b4-42f9-a72f-93838096a814 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b688f426-9aef-47b8-9d15-dfabee2168ea" returned: 0 in 0.321s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:42 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1503af56-04b4-42f9-a72f-93838096a814 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "cinder-quobyte-b688f426-9aef-47b8-9d15-dfabee2168ea" released by "delete_volume" :: held 0.757s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:50:42 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-1503af56-04b4-42f9-a72f-93838096a814 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Created reservations ['909a2363-e416-41cf-8e81-90d447270452', '0a22b691-dab1-49d7-9f35-af13e573fde8', '99839740-9323-4208-9414-6645ed87572c', 'c722e5f7-8934-4f65-b950-c3eaccd39ef8'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:50:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1503af56-04b4-42f9-a72f-93838096a814 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1503af56-04b4-42f9-a72f-93838096a814 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:42 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-1503af56-04b4-42f9-a72f-93838096a814 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:42 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-1503af56-04b4-42f9-a72f-93838096a814 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1503af56-04b4-42f9-a72f-93838096a814 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1503af56-04b4-42f9-a72f-93838096a814 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:42 devstack sudo[101955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:50:42 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:42 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-74af9a4e-3a9e-4870-b9ac-aa80f7fe4a29 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Acquiring lock "cinder-04c09bc8-6fd0-47cf-8caa-409284a5d56c-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:50:42 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-74af9a4e-3a9e-4870-b9ac-aa80f7fe4a29 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "cinder-04c09bc8-6fd0-47cf-8caa-409284a5d56c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:50:42 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-74af9a4e-3a9e-4870-b9ac-aa80f7fe4a29 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Acquiring lock "cinder-quobyte-04c09bc8-6fd0-47cf-8caa-409284a5d56c" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:50:42 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-74af9a4e-3a9e-4870-b9ac-aa80f7fe4a29 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "cinder-quobyte-04c09bc8-6fd0-47cf-8caa-409284a5d56c" acquired by "delete_volume" :: waited 0.036s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:50:42 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1503af56-04b4-42f9-a72f-93838096a814 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.464s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:42 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-1503af56-04b4-42f9-a72f-93838096a814 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:50:42 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-1503af56-04b4-42f9-a72f-93838096a814 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Deleted volume successfully. Jul 17 19:50:42 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac884851-f84f-47f3-9b33-de0c7078c81b]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:50:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-74af9a4e-3a9e-4870-b9ac-aa80f7fe4a29 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-04c09bc8-6fd0-47cf-8caa-409284a5d56c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:42 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1503af56-04b4-42f9-a72f-93838096a814 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "cinder-b688f426-9aef-47b8-9d15-dfabee2168ea-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:50:42 devstack sudo[102304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-04c09bc8-6fd0-47cf-8caa-409284a5d56c Jul 17 19:50:42 devstack sudo[102304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:43 devstack sudo[102304]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-74af9a4e-3a9e-4870-b9ac-aa80f7fe4a29 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-04c09bc8-6fd0-47cf-8caa-409284a5d56c" returned: 0 in 0.561s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-74af9a4e-3a9e-4870-b9ac-aa80f7fe4a29 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-04c09bc8-6fd0-47cf-8caa-409284a5d56c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:43 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-04c09bc8-6fd0-47cf-8caa-409284a5d56c Jul 17 19:50:43 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:43 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-74af9a4e-3a9e-4870-b9ac-aa80f7fe4a29 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-04c09bc8-6fd0-47cf-8caa-409284a5d56c" returned: 0 in 0.382s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:43 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-74af9a4e-3a9e-4870-b9ac-aa80f7fe4a29 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "cinder-quobyte-04c09bc8-6fd0-47cf-8caa-409284a5d56c" released by "delete_volume" :: held 1.030s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:50:43 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-74af9a4e-3a9e-4870-b9ac-aa80f7fe4a29 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Created reservations ['91998908-bb06-4559-b996-55c3154dd5ee', '83619799-2349-4436-923f-e79fc61a64cb', 'ea34a796-c39c-4ceb-99c6-67a22fb14c81', '00797b09-e23f-46c3-b556-a328a4f4cf8d'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:50:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-74af9a4e-3a9e-4870-b9ac-aa80f7fe4a29 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-74af9a4e-3a9e-4870-b9ac-aa80f7fe4a29 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:43 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-74af9a4e-3a9e-4870-b9ac-aa80f7fe4a29 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:43 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-74af9a4e-3a9e-4870-b9ac-aa80f7fe4a29 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-74af9a4e-3a9e-4870-b9ac-aa80f7fe4a29 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-74af9a4e-3a9e-4870-b9ac-aa80f7fe4a29 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:43 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:50:43 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:44 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-74af9a4e-3a9e-4870-b9ac-aa80f7fe4a29 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.262s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:44 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-74af9a4e-3a9e-4870-b9ac-aa80f7fe4a29 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:50:44 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-74af9a4e-3a9e-4870-b9ac-aa80f7fe4a29 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Deleted volume successfully. Jul 17 19:50:44 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-74af9a4e-3a9e-4870-b9ac-aa80f7fe4a29 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "cinder-04c09bc8-6fd0-47cf-8caa-409284a5d56c-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:50:45 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-cfb12925-cc87-44ef-b871-ade3c2a597db tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Acquiring lock "cinder-a3fb7537-1b66-4235-b617-ad5d87a29f98-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:50:45 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-cfb12925-cc87-44ef-b871-ade3c2a597db tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "cinder-a3fb7537-1b66-4235-b617-ad5d87a29f98-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:50:45 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-cfb12925-cc87-44ef-b871-ade3c2a597db tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Acquiring lock "cinder-quobyte-a3fb7537-1b66-4235-b617-ad5d87a29f98" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:50:45 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-cfb12925-cc87-44ef-b871-ade3c2a597db tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "cinder-quobyte-a3fb7537-1b66-4235-b617-ad5d87a29f98" acquired by "delete_volume" :: waited 0.021s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:50:45 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc8ccc4-3a83-4025-b3c3-a4bffd56d137]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:50:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cfb12925-cc87-44ef-b871-ade3c2a597db tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a3fb7537-1b66-4235-b617-ad5d87a29f98 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:45 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a3fb7537-1b66-4235-b617-ad5d87a29f98 Jul 17 19:50:45 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:45 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cfb12925-cc87-44ef-b871-ade3c2a597db tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a3fb7537-1b66-4235-b617-ad5d87a29f98" returned: 0 in 0.538s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cfb12925-cc87-44ef-b871-ade3c2a597db tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a3fb7537-1b66-4235-b617-ad5d87a29f98 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:45 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a3fb7537-1b66-4235-b617-ad5d87a29f98 Jul 17 19:50:45 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:46 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cfb12925-cc87-44ef-b871-ade3c2a597db tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a3fb7537-1b66-4235-b617-ad5d87a29f98" returned: 0 in 0.373s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-cfb12925-cc87-44ef-b871-ade3c2a597db tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "cinder-quobyte-a3fb7537-1b66-4235-b617-ad5d87a29f98" released by "delete_volume" :: held 1.014s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:50:46 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-cfb12925-cc87-44ef-b871-ade3c2a597db tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Created reservations ['a45030ce-d5da-40a4-b9e0-2d3c14d4758b', 'e2d30bde-32c4-49ff-bc9a-78818ad519dd', '9e0198f3-0749-4c54-8a68-642e93835b3f', '7f53c65f-87d1-48cd-a7c5-8420634057cf'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:50:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cfb12925-cc87-44ef-b871-ade3c2a597db tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cfb12925-cc87-44ef-b871-ade3c2a597db tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:46 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cfb12925-cc87-44ef-b871-ade3c2a597db tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:46 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cfb12925-cc87-44ef-b871-ade3c2a597db tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cfb12925-cc87-44ef-b871-ade3c2a597db tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cfb12925-cc87-44ef-b871-ade3c2a597db tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:46 devstack sudo[102358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:50:46 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:46 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cfb12925-cc87-44ef-b871-ade3c2a597db tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.325s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:46 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-cfb12925-cc87-44ef-b871-ade3c2a597db tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:50:46 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-cfb12925-cc87-44ef-b871-ade3c2a597db tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Deleted volume successfully. Jul 17 19:50:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-cfb12925-cc87-44ef-b871-ade3c2a597db tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "cinder-a3fb7537-1b66-4235-b617-ad5d87a29f98-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:50:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-50e1fea5-7483-4aad-b57c-4a1a11268e04 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Acquiring lock "cinder-63515b6d-a80f-4c8e-a034-4521f0e6b754-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:50:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-50e1fea5-7483-4aad-b57c-4a1a11268e04 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "cinder-63515b6d-a80f-4c8e-a034-4521f0e6b754-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:50:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-50e1fea5-7483-4aad-b57c-4a1a11268e04 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Acquiring lock "cinder-quobyte-63515b6d-a80f-4c8e-a034-4521f0e6b754" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:50:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-50e1fea5-7483-4aad-b57c-4a1a11268e04 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "cinder-quobyte-63515b6d-a80f-4c8e-a034-4521f0e6b754" acquired by "delete_volume" :: waited 0.024s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:50:47 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a8d73c-3b18-461e-9f3b-9a0227e7dc63]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:50:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-50e1fea5-7483-4aad-b57c-4a1a11268e04 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-63515b6d-a80f-4c8e-a034-4521f0e6b754 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:47 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-63515b6d-a80f-4c8e-a034-4521f0e6b754 Jul 17 19:50:47 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:48 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-50e1fea5-7483-4aad-b57c-4a1a11268e04 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-63515b6d-a80f-4c8e-a034-4521f0e6b754" returned: 0 in 0.609s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-50e1fea5-7483-4aad-b57c-4a1a11268e04 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-63515b6d-a80f-4c8e-a034-4521f0e6b754 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:48 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-63515b6d-a80f-4c8e-a034-4521f0e6b754 Jul 17 19:50:48 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:48 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-50e1fea5-7483-4aad-b57c-4a1a11268e04 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-63515b6d-a80f-4c8e-a034-4521f0e6b754" returned: 0 in 0.467s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:48 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-50e1fea5-7483-4aad-b57c-4a1a11268e04 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "cinder-quobyte-63515b6d-a80f-4c8e-a034-4521f0e6b754" released by "delete_volume" :: held 1.151s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:50:48 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-50e1fea5-7483-4aad-b57c-4a1a11268e04 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Created reservations ['7f831f11-8f71-40ef-855f-cbc6080627da', 'cb54bb9c-9e60-4089-bb3a-e9c1fc43db94', '062e9005-d41d-4d34-a950-a3da284ab6a2', '75a07cc4-c3b3-4e33-a96b-4d045de51c65'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:50:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-50e1fea5-7483-4aad-b57c-4a1a11268e04 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-50e1fea5-7483-4aad-b57c-4a1a11268e04 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:48 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-50e1fea5-7483-4aad-b57c-4a1a11268e04 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:48 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-50e1fea5-7483-4aad-b57c-4a1a11268e04 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-50e1fea5-7483-4aad-b57c-4a1a11268e04 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-50e1fea5-7483-4aad-b57c-4a1a11268e04 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:48 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:50:48 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:49 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-50e1fea5-7483-4aad-b57c-4a1a11268e04 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.293s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:49 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-50e1fea5-7483-4aad-b57c-4a1a11268e04 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:50:49 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-50e1fea5-7483-4aad-b57c-4a1a11268e04 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Deleted volume successfully. Jul 17 19:50:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-50e1fea5-7483-4aad-b57c-4a1a11268e04 tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "cinder-63515b6d-a80f-4c8e-a034-4521f0e6b754-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:50:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-8d60448d-4abf-488d-b5d3-5f55cbe4f90a tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Acquiring lock "cinder-6d14024c-f5f4-4229-a80d-01065986fbf7-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:50:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-8d60448d-4abf-488d-b5d3-5f55cbe4f90a tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "cinder-6d14024c-f5f4-4229-a80d-01065986fbf7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:50:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-8d60448d-4abf-488d-b5d3-5f55cbe4f90a tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Acquiring lock "cinder-quobyte-6d14024c-f5f4-4229-a80d-01065986fbf7" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:50:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-8d60448d-4abf-488d-b5d3-5f55cbe4f90a tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "cinder-quobyte-6d14024c-f5f4-4229-a80d-01065986fbf7" acquired by "delete_volume" :: waited 0.029s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:50:49 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[a254eb3e-dc0b-4933-a8f6-3725c5e2e3e3]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:50:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8d60448d-4abf-488d-b5d3-5f55cbe4f90a tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6d14024c-f5f4-4229-a80d-01065986fbf7 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:49 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6d14024c-f5f4-4229-a80d-01065986fbf7 Jul 17 19:50:49 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:50 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8d60448d-4abf-488d-b5d3-5f55cbe4f90a tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6d14024c-f5f4-4229-a80d-01065986fbf7" returned: 0 in 0.441s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8d60448d-4abf-488d-b5d3-5f55cbe4f90a tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6d14024c-f5f4-4229-a80d-01065986fbf7 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:50 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6d14024c-f5f4-4229-a80d-01065986fbf7 Jul 17 19:50:50 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:50 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8d60448d-4abf-488d-b5d3-5f55cbe4f90a tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6d14024c-f5f4-4229-a80d-01065986fbf7" returned: 0 in 0.328s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:50 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-8d60448d-4abf-488d-b5d3-5f55cbe4f90a tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "cinder-quobyte-6d14024c-f5f4-4229-a80d-01065986fbf7" released by "delete_volume" :: held 0.824s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:50:50 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-8d60448d-4abf-488d-b5d3-5f55cbe4f90a tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Created reservations ['f1bd57ae-a50a-42a2-840d-b5f6373dd907', '83b2948e-c53a-4578-8bf8-21ce979caa4a', '7ffbfeaf-926a-4456-b549-1b4144ff8921', '9be4063c-53e0-4a4b-b65b-e3c0a2da78ba'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:50:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8d60448d-4abf-488d-b5d3-5f55cbe4f90a tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8d60448d-4abf-488d-b5d3-5f55cbe4f90a tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:50 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8d60448d-4abf-488d-b5d3-5f55cbe4f90a tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:50 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8d60448d-4abf-488d-b5d3-5f55cbe4f90a tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8d60448d-4abf-488d-b5d3-5f55cbe4f90a tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8d60448d-4abf-488d-b5d3-5f55cbe4f90a tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:50 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:50:50 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:51 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8d60448d-4abf-488d-b5d3-5f55cbe4f90a tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.367s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:51 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-8d60448d-4abf-488d-b5d3-5f55cbe4f90a tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:50:51 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-8d60448d-4abf-488d-b5d3-5f55cbe4f90a tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Deleted volume successfully. Jul 17 19:50:51 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-8d60448d-4abf-488d-b5d3-5f55cbe4f90a tempest-CreateVolumesFromSourceVolumeTest-1689763887 None] Lock "cinder-6d14024c-f5f4-4229-a80d-01065986fbf7-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:50:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-c010b2ff-bb51-41ea-8a0f-1b11476567fc req-b2861a78-e747-43b3-b290-41942e24fa5e tempest-TestStampPattern-1595853218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-c010b2ff-bb51-41ea-8a0f-1b11476567fc req-b2861a78-e747-43b3-b290-41942e24fa5e tempest-TestStampPattern-1595853218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-c010b2ff-bb51-41ea-8a0f-1b11476567fc req-b2861a78-e747-43b3-b290-41942e24fa5e tempest-TestStampPattern-1595853218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-c010b2ff-bb51-41ea-8a0f-1b11476567fc req-b2861a78-e747-43b3-b290-41942e24fa5e tempest-TestStampPattern-1595853218 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55', 'name': 'volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6c41b69d-7119-4cf2-9efb-2b749705ca61', 'enforce_multipath': True} {{(pid=87726) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 19:50:52 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-c010b2ff-bb51-41ea-8a0f-1b11476567fc req-b2861a78-e747-43b3-b290-41942e24fa5e tempest-TestStampPattern-1595853218 None] attachment_update completed successfully. Jul 17 19:50:54 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:50:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] Flow 'volume_create_manager' (e778a29b-e1e1-4566-8f5f-07c9dccd6265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a63c9a9b-a4e0-4fd8-86c9-9c3ed1e63f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a63c9a9b-a4e0-4fd8-86c9-9c3ed1e63f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d944f278-acfa-4665-b151-8c8772d5a591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e1cab1351644b7aa7d43b8a381bd3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:55Z,use_quota=True,user_id='88fa6991b73b4826b83301700be26f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9890e0cf-bc6d-419d-9e22-1c46722a6d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9890e0cf-bc6d-419d-9e22-1c46722a6d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (002b4958-8ef1-44f4-93da-a4d1e4dc1aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (002b4958-8ef1-44f4-93da-a4d1e4dc1aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd944f278-acfa-4665-b151-8c8772d5a591', 'volume_name': 'volume-d944f278-acfa-4665-b151-8c8772d5a591', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dac5a08-82ae-473c-8f7a-85ef5490a293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dac5a08-82ae-473c-8f7a-85ef5490a293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26aea564-7115-41e8-b312-e6a04647be38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:55 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] Volume d944f278-acfa-4665-b151-8c8772d5a591: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d944f278-acfa-4665-b151-8c8772d5a591', 'volume_size': 1} Jul 17 19:50:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:55 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d944f278-acfa-4665-b151-8c8772d5a591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e1cab1351644b7aa7d43b8a381bd3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:55Z,use_quota=True,user_id='88fa6991b73b4826b83301700be26f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:50:55 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] Creating volume d944f278-acfa-4665-b151-8c8772d5a591 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:50:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:55 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:55 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:55 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:50:55 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:50:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d944f278-acfa-4665-b151-8c8772d5a591 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:55 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d944f278-acfa-4665-b151-8c8772d5a591 1073741824 Jul 17 19:50:55 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:55 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d944f278-acfa-4665-b151-8c8772d5a591 1073741824" returned: 0 in 0.480s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d944f278-acfa-4665-b151-8c8772d5a591 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:55 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d944f278-acfa-4665-b151-8c8772d5a591 Jul 17 19:50:55 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:55 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d944f278-acfa-4665-b151-8c8772d5a591" returned: 0 in 0.262s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:55 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:50:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26aea564-7115-41e8-b312-e6a04647be38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d944f278-acfa-4665-b151-8c8772d5a591', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (639c6ca0-0bab-4c3d-98dd-7bfd1656ad4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:55 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] Volume volume-d944f278-acfa-4665-b151-8c8772d5a591 (d944f278-acfa-4665-b151-8c8772d5a591): created successfully Jul 17 19:50:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (639c6ca0-0bab-4c3d-98dd-7bfd1656ad4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] Flow 'volume_create_manager' (e778a29b-e1e1-4566-8f5f-07c9dccd6265) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:55 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-14db92c6-b2d7-4155-a5ec-f1a30341763b tempest-CinderUnicodeTest-1203001551 None] Created volume successfully. Jul 17 19:50:57 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:50:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] Flow 'volume_create_manager' (c384d7d2-d2b6-4ca5-9333-398aec7d6a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (115b1bc8-f7c1-4caa-92a3-b0c5cf78e565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (115b1bc8-f7c1-4caa-92a3-b0c5cf78e565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1065399772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bda2ec8-bd45-4085-ad5d-b938e81c91db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e1cab1351644b7aa7d43b8a381bd3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:58Z,use_quota=True,user_id='88fa6991b73b4826b83301700be26f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f21fe046-458c-4fbf-a102-e6b82d5a6c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f21fe046-458c-4fbf-a102-e6b82d5a6c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89b2b85e-d89b-41b6-9327-10113cdbb194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89b2b85e-d89b-41b6-9327-10113cdbb194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bda2ec8-bd45-4085-ad5d-b938e81c91db', 'volume_name': 'volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a2ac304-a984-498e-aaa2-195a5f25ce43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a2ac304-a984-498e-aaa2-195a5f25ce43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1747deaf-2aee-4764-b3b5-fe3f460d3104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:57 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] Volume 4bda2ec8-bd45-4085-ad5d-b938e81c91db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db', 'volume_size': 1} Jul 17 19:50:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:57 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:50:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1065399772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bda2ec8-bd45-4085-ad5d-b938e81c91db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e1cab1351644b7aa7d43b8a381bd3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:50:58Z,use_quota=True,user_id='88fa6991b73b4826b83301700be26f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:50:57 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] Creating volume 4bda2ec8-bd45-4085-ad5d-b938e81c91db {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:50:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:57 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:50:57 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:50:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:57 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:50:57 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:50:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:57 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db 1073741824 Jul 17 19:50:57 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:58 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-b19767f8-2b46-4fde-9576-3bc7d4df97b7 req-dbfdf847-f455-4d99-9b0c-7375318335ac tempest-TestStampPattern-1595853218 None] Terminate volume connection completed successfully. Jul 17 19:50:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-b19767f8-2b46-4fde-9576-3bc7d4df97b7 req-dbfdf847-f455-4d99-9b0c-7375318335ac tempest-TestStampPattern-1595853218 None] Deleting attachment 6c41b69d-7119-4cf2-9efb-2b749705ca61. {{(pid=87726) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 19:50:58 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db 1073741824" returned: 0 in 0.507s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:58 devstack sudo[102485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db Jul 17 19:50:58 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:58 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db" returned: 0 in 0.251s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:50:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:50:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1747deaf-2aee-4764-b3b5-fe3f460d3104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c36739a-9339-49bb-8e49-d1f5c7ec8667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:50:58 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] Volume volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db (4bda2ec8-bd45-4085-ad5d-b938e81c91db): created successfully Jul 17 19:50:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c36739a-9339-49bb-8e49-d1f5c7ec8667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:50:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] Flow 'volume_create_manager' (c384d7d2-d2b6-4ca5-9333-398aec7d6a9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:50:58 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-b6cea341-d45f-4add-ab7c-cb38ca0ead3a tempest-CinderUnicodeTest-1203001551 None] Created volume successfully. Jul 17 19:50:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-54a015f8-a711-4774-8aa4-41c26bea27bc tempest-TestStampPattern-1595853218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:50:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-54a015f8-a711-4774-8aa4-41c26bea27bc tempest-TestStampPattern-1595853218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:50:59 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-54a015f8-a711-4774-8aa4-41c26bea27bc tempest-TestStampPattern-1595853218 None] Creating offline snapshot 48f08360-d265-4cf0-9217-96443e4f0827 of volume 98dbaed7-0773-4d32-b9c5-04b0eaaffd90 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:50:59 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[b168265b-3ddf-48ca-8eae-560c63792489]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:50:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-54a015f8-a711-4774-8aa4-41c26bea27bc tempest-TestStampPattern-1595853218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:59 devstack sudo[102488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90 Jul 17 19:50:59 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:59 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-54a015f8-a711-4774-8aa4-41c26bea27bc tempest-TestStampPattern-1595853218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90" returned: 0 in 0.364s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-54a015f8-a711-4774-8aa4-41c26bea27bc tempest-TestStampPattern-1595853218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90.48f08360-d265-4cf0-9217-96443e4f0827 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:59 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90.48f08360-d265-4cf0-9217-96443e4f0827 1G Jul 17 19:50:59 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:50:59 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Jul 17 19:50:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-54a015f8-a711-4774-8aa4-41c26bea27bc tempest-TestStampPattern-1595853218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90.48f08360-d265-4cf0-9217-96443e4f0827 1G" returned: 0 in 0.508s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:50:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-54a015f8-a711-4774-8aa4-41c26bea27bc tempest-TestStampPattern-1595853218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90.48f08360-d265-4cf0-9217-96443e4f0827 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:50:59 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90.48f08360-d265-4cf0-9217-96443e4f0827 Jul 17 19:50:59 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7176be51-cc51-43d0-bab1-dfd9fe4495d0 tempest-CinderUnicodeTest-1203001551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:51:00 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-54a015f8-a711-4774-8aa4-41c26bea27bc tempest-TestStampPattern-1595853218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90.48f08360-d265-4cf0-9217-96443e4f0827" returned: 0 in 0.365s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:00 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-54a015f8-a711-4774-8aa4-41c26bea27bc tempest-TestStampPattern-1595853218 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90.48f08360-d265-4cf0-9217-96443e4f0827 is being set with open permissions: ugo+rw Jul 17 19:51:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-54a015f8-a711-4774-8aa4-41c26bea27bc tempest-TestStampPattern-1595853218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90.48f08360-d265-4cf0-9217-96443e4f0827 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:00 devstack sudo[102508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90.48f08360-d265-4cf0-9217-96443e4f0827 Jul 17 19:51:00 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:00 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-54a015f8-a711-4774-8aa4-41c26bea27bc tempest-TestStampPattern-1595853218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90.48f08360-d265-4cf0-9217-96443e4f0827" returned: 0 in 0.257s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-54a015f8-a711-4774-8aa4-41c26bea27bc tempest-TestStampPattern-1595853218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:00 devstack sudo[102511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90.info Jul 17 19:51:00 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:00 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-54a015f8-a711-4774-8aa4-41c26bea27bc tempest-TestStampPattern-1595853218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90.info" returned: 0 in 0.256s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:00 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-54a015f8-a711-4774-8aa4-41c26bea27bc tempest-TestStampPattern-1595853218 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90.info is being set with open permissions: ugo+rw Jul 17 19:51:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-54a015f8-a711-4774-8aa4-41c26bea27bc tempest-TestStampPattern-1595853218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:00 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90.info Jul 17 19:51:00 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:01 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-54a015f8-a711-4774-8aa4-41c26bea27bc tempest-TestStampPattern-1595853218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90.info" returned: 0 in 0.282s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-54a015f8-a711-4774-8aa4-41c26bea27bc tempest-TestStampPattern-1595853218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.128s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:51:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7176be51-cc51-43d0-bab1-dfd9fe4495d0 tempest-CinderUnicodeTest-1203001551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.119s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:51:01 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-7176be51-cc51-43d0-bab1-dfd9fe4495d0 tempest-CinderUnicodeTest-1203001551 None] Creating offline snapshot 596d18fc-b25c-4064-84d4-3b1503b5f27d of volume 4bda2ec8-bd45-4085-ad5d-b938e81c91db {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:51:01 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[039be8da-4d8f-4bcd-89bb-9f5b756f7f44]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:51:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7176be51-cc51-43d0-bab1-dfd9fe4495d0 tempest-CinderUnicodeTest-1203001551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:01 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-54a015f8-a711-4774-8aa4-41c26bea27bc tempest-TestStampPattern-1595853218 None] Create snapshot completed successfully Jul 17 19:51:01 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db Jul 17 19:51:01 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:01 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7176be51-cc51-43d0-bab1-dfd9fe4495d0 tempest-CinderUnicodeTest-1203001551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db" returned: 0 in 0.359s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7176be51-cc51-43d0-bab1-dfd9fe4495d0 tempest-CinderUnicodeTest-1203001551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db.596d18fc-b25c-4064-84d4-3b1503b5f27d 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:01 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db.596d18fc-b25c-4064-84d4-3b1503b5f27d 1G Jul 17 19:51:01 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:01 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7176be51-cc51-43d0-bab1-dfd9fe4495d0 tempest-CinderUnicodeTest-1203001551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db.596d18fc-b25c-4064-84d4-3b1503b5f27d 1G" returned: 0 in 0.405s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7176be51-cc51-43d0-bab1-dfd9fe4495d0 tempest-CinderUnicodeTest-1203001551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db.596d18fc-b25c-4064-84d4-3b1503b5f27d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:01 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db.596d18fc-b25c-4064-84d4-3b1503b5f27d Jul 17 19:51:01 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:02 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7176be51-cc51-43d0-bab1-dfd9fe4495d0 tempest-CinderUnicodeTest-1203001551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db.596d18fc-b25c-4064-84d4-3b1503b5f27d" returned: 0 in 0.330s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:02 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-7176be51-cc51-43d0-bab1-dfd9fe4495d0 tempest-CinderUnicodeTest-1203001551 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db.596d18fc-b25c-4064-84d4-3b1503b5f27d is being set with open permissions: ugo+rw Jul 17 19:51:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7176be51-cc51-43d0-bab1-dfd9fe4495d0 tempest-CinderUnicodeTest-1203001551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db.596d18fc-b25c-4064-84d4-3b1503b5f27d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:02 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db.596d18fc-b25c-4064-84d4-3b1503b5f27d Jul 17 19:51:02 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:02 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7176be51-cc51-43d0-bab1-dfd9fe4495d0 tempest-CinderUnicodeTest-1203001551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db.596d18fc-b25c-4064-84d4-3b1503b5f27d" returned: 0 in 0.253s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7176be51-cc51-43d0-bab1-dfd9fe4495d0 tempest-CinderUnicodeTest-1203001551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:02 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db.info Jul 17 19:51:02 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:02 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7176be51-cc51-43d0-bab1-dfd9fe4495d0 tempest-CinderUnicodeTest-1203001551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db.info" returned: 0 in 0.269s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:02 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-7176be51-cc51-43d0-bab1-dfd9fe4495d0 tempest-CinderUnicodeTest-1203001551 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db.info is being set with open permissions: ugo+rw Jul 17 19:51:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7176be51-cc51-43d0-bab1-dfd9fe4495d0 tempest-CinderUnicodeTest-1203001551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:02 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db.info Jul 17 19:51:02 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:03 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7176be51-cc51-43d0-bab1-dfd9fe4495d0 tempest-CinderUnicodeTest-1203001551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db.info" returned: 0 in 0.285s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7176be51-cc51-43d0-bab1-dfd9fe4495d0 tempest-CinderUnicodeTest-1203001551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.004s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:51:03 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-7176be51-cc51-43d0-bab1-dfd9fe4495d0 tempest-CinderUnicodeTest-1203001551 None] Create snapshot completed successfully Jul 17 19:51:04 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-77b9b7fb-0e08-448e-95f4-5503fa693e65 tempest-CinderUnicodeTest-1203001551 None] Acquiring lock "cinder-596d18fc-b25c-4064-84d4-3b1503b5f27d-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:51:04 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-77b9b7fb-0e08-448e-95f4-5503fa693e65 tempest-CinderUnicodeTest-1203001551 None] Lock "cinder-596d18fc-b25c-4064-84d4-3b1503b5f27d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:51:04 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-77b9b7fb-0e08-448e-95f4-5503fa693e65 tempest-CinderUnicodeTest-1203001551 None] Acquiring lock "cinder-quobyte-4bda2ec8-bd45-4085-ad5d-b938e81c91db" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:51:04 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-77b9b7fb-0e08-448e-95f4-5503fa693e65 tempest-CinderUnicodeTest-1203001551 None] Lock "cinder-quobyte-4bda2ec8-bd45-4085-ad5d-b938e81c91db" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:51:04 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-77b9b7fb-0e08-448e-95f4-5503fa693e65 tempest-CinderUnicodeTest-1203001551 None] Acquiring lock "cinder-quobyte-596d18fc-b25c-4064-84d4-3b1503b5f27d" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:51:04 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-77b9b7fb-0e08-448e-95f4-5503fa693e65 tempest-CinderUnicodeTest-1203001551 None] Lock "cinder-quobyte-596d18fc-b25c-4064-84d4-3b1503b5f27d" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:51:04 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-77b9b7fb-0e08-448e-95f4-5503fa693e65 tempest-CinderUnicodeTest-1203001551 None] Deleting offline snapshot 596d18fc-b25c-4064-84d4-3b1503b5f27d of volume 4bda2ec8-bd45-4085-ad5d-b938e81c91db {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:51:04 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-77b9b7fb-0e08-448e-95f4-5503fa693e65 tempest-CinderUnicodeTest-1203001551 None] snapshot_file for this snap is: volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db.596d18fc-b25c-4064-84d4-3b1503b5f27d {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:51:04 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb4a5f8-9faf-4bb0-ad38-fdd92d28202f]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:51:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-77b9b7fb-0e08-448e-95f4-5503fa693e65 tempest-CinderUnicodeTest-1203001551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db.596d18fc-b25c-4064-84d4-3b1503b5f27d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:04 devstack sudo[102586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db.596d18fc-b25c-4064-84d4-3b1503b5f27d Jul 17 19:51:04 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:04 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-77b9b7fb-0e08-448e-95f4-5503fa693e65 tempest-CinderUnicodeTest-1203001551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db.596d18fc-b25c-4064-84d4-3b1503b5f27d" returned: 0 in 0.366s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:04 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-77b9b7fb-0e08-448e-95f4-5503fa693e65 tempest-CinderUnicodeTest-1203001551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:51:04 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25a704c-4740-4fc9-99cb-3d2d8c2d3cb7]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:51:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-77b9b7fb-0e08-448e-95f4-5503fa693e65 tempest-CinderUnicodeTest-1203001551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:04 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db Jul 17 19:51:04 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:05 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-77b9b7fb-0e08-448e-95f4-5503fa693e65 tempest-CinderUnicodeTest-1203001551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db" returned: 0 in 0.378s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-77b9b7fb-0e08-448e-95f4-5503fa693e65 tempest-CinderUnicodeTest-1203001551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db.596d18fc-b25c-4064-84d4-3b1503b5f27d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:05 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db.596d18fc-b25c-4064-84d4-3b1503b5f27d Jul 17 19:51:05 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:05 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-77b9b7fb-0e08-448e-95f4-5503fa693e65 tempest-CinderUnicodeTest-1203001551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db.596d18fc-b25c-4064-84d4-3b1503b5f27d" returned: 0 in 0.391s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-77b9b7fb-0e08-448e-95f4-5503fa693e65 tempest-CinderUnicodeTest-1203001551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db.596d18fc-b25c-4064-84d4-3b1503b5f27d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:05 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db.596d18fc-b25c-4064-84d4-3b1503b5f27d Jul 17 19:51:05 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:05 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-77b9b7fb-0e08-448e-95f4-5503fa693e65 tempest-CinderUnicodeTest-1203001551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db.596d18fc-b25c-4064-84d4-3b1503b5f27d" returned: 0 in 0.254s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-77b9b7fb-0e08-448e-95f4-5503fa693e65 tempest-CinderUnicodeTest-1203001551 None] Lock "cinder-quobyte-596d18fc-b25c-4064-84d4-3b1503b5f27d" released by "_delete_snapshot" :: held 1.497s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:51:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-77b9b7fb-0e08-448e-95f4-5503fa693e65 tempest-CinderUnicodeTest-1203001551 None] Lock "cinder-quobyte-4bda2ec8-bd45-4085-ad5d-b938e81c91db" released by "delete_snapshot" :: held 1.519s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:51:05 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-77b9b7fb-0e08-448e-95f4-5503fa693e65 tempest-CinderUnicodeTest-1203001551 None] Created reservations ['a0ee1de7-1272-4d0e-abf8-d6585759e1e8', '6a667d70-2ec9-467b-801a-0873f9653ac9', 'a8574603-37a8-4f93-88ce-89873c9bc101', '68f4a935-684a-418d-bac1-eee91d15d844'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:51:05 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-77b9b7fb-0e08-448e-95f4-5503fa693e65 tempest-CinderUnicodeTest-1203001551 None] Delete snapshot completed successfully. Jul 17 19:51:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-77b9b7fb-0e08-448e-95f4-5503fa693e65 tempest-CinderUnicodeTest-1203001551 None] Lock "cinder-596d18fc-b25c-4064-84d4-3b1503b5f27d-delete_snapshot" released by "delete_snapshot" :: held 1.668s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:51:06 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-29c56595-f4c7-4603-8352-6af9713d7598 tempest-CinderUnicodeTest-1203001551 None] Acquiring lock "cinder-4bda2ec8-bd45-4085-ad5d-b938e81c91db-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:51:06 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-29c56595-f4c7-4603-8352-6af9713d7598 tempest-CinderUnicodeTest-1203001551 None] Lock "cinder-4bda2ec8-bd45-4085-ad5d-b938e81c91db-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:51:06 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-29c56595-f4c7-4603-8352-6af9713d7598 tempest-CinderUnicodeTest-1203001551 None] Acquiring lock "cinder-quobyte-4bda2ec8-bd45-4085-ad5d-b938e81c91db" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:51:06 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-29c56595-f4c7-4603-8352-6af9713d7598 tempest-CinderUnicodeTest-1203001551 None] Lock "cinder-quobyte-4bda2ec8-bd45-4085-ad5d-b938e81c91db" acquired by "delete_volume" :: waited 0.017s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:51:06 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d09f90-cef7-4e0e-92ae-9a713f283e70]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:51:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-29c56595-f4c7-4603-8352-6af9713d7598 tempest-CinderUnicodeTest-1203001551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:06 devstack sudo[102613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db Jul 17 19:51:06 devstack sudo[102613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:06 devstack sudo[102613]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-29c56595-f4c7-4603-8352-6af9713d7598 tempest-CinderUnicodeTest-1203001551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db" returned: 0 in 0.383s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-29c56595-f4c7-4603-8352-6af9713d7598 tempest-CinderUnicodeTest-1203001551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:06 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db Jul 17 19:51:06 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:07 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-29c56595-f4c7-4603-8352-6af9713d7598 tempest-CinderUnicodeTest-1203001551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4bda2ec8-bd45-4085-ad5d-b938e81c91db" returned: 0 in 0.275s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:07 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-29c56595-f4c7-4603-8352-6af9713d7598 tempest-CinderUnicodeTest-1203001551 None] Lock "cinder-quobyte-4bda2ec8-bd45-4085-ad5d-b938e81c91db" released by "delete_volume" :: held 0.728s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:51:07 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-29c56595-f4c7-4603-8352-6af9713d7598 tempest-CinderUnicodeTest-1203001551 None] Created reservations ['912631c5-ceaf-4260-8ab2-d506d3e0b63b', 'ff210239-1d8f-440c-a5cb-4949160af805', '4936ea2a-0b42-49dc-b2e2-079e44b32299', '9b6b19eb-f9c0-4e0f-812f-f09bc33e9cc5'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:51:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-29c56595-f4c7-4603-8352-6af9713d7598 tempest-CinderUnicodeTest-1203001551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:51:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-29c56595-f4c7-4603-8352-6af9713d7598 tempest-CinderUnicodeTest-1203001551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:51:07 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-29c56595-f4c7-4603-8352-6af9713d7598 tempest-CinderUnicodeTest-1203001551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:51:07 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-29c56595-f4c7-4603-8352-6af9713d7598 tempest-CinderUnicodeTest-1203001551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:51:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-29c56595-f4c7-4603-8352-6af9713d7598 tempest-CinderUnicodeTest-1203001551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:51:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-29c56595-f4c7-4603-8352-6af9713d7598 tempest-CinderUnicodeTest-1203001551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:07 devstack sudo[102621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:51:07 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:07 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e991aa4f-3293-4762-a0a4-64d401c9ae15 tempest-CinderUnicodeTest-1203001551 None] Acquiring lock "cinder-d944f278-acfa-4665-b151-8c8772d5a591-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:51:07 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e991aa4f-3293-4762-a0a4-64d401c9ae15 tempest-CinderUnicodeTest-1203001551 None] Lock "cinder-d944f278-acfa-4665-b151-8c8772d5a591-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:51:07 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-29c56595-f4c7-4603-8352-6af9713d7598 tempest-CinderUnicodeTest-1203001551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.347s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:07 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-29c56595-f4c7-4603-8352-6af9713d7598 tempest-CinderUnicodeTest-1203001551 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:51:07 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e991aa4f-3293-4762-a0a4-64d401c9ae15 tempest-CinderUnicodeTest-1203001551 None] Acquiring lock "cinder-quobyte-d944f278-acfa-4665-b151-8c8772d5a591" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:51:07 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-29c56595-f4c7-4603-8352-6af9713d7598 tempest-CinderUnicodeTest-1203001551 None] Deleted volume successfully. Jul 17 19:51:07 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e991aa4f-3293-4762-a0a4-64d401c9ae15 tempest-CinderUnicodeTest-1203001551 None] Lock "cinder-quobyte-d944f278-acfa-4665-b151-8c8772d5a591" acquired by "delete_volume" :: waited 0.026s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:51:07 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-29c56595-f4c7-4603-8352-6af9713d7598 tempest-CinderUnicodeTest-1203001551 None] Lock "cinder-4bda2ec8-bd45-4085-ad5d-b938e81c91db-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:51:07 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a13207-f726-4796-9a26-0102915e8229]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:51:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e991aa4f-3293-4762-a0a4-64d401c9ae15 tempest-CinderUnicodeTest-1203001551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d944f278-acfa-4665-b151-8c8772d5a591 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:07 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d944f278-acfa-4665-b151-8c8772d5a591 Jul 17 19:51:07 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:08 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e991aa4f-3293-4762-a0a4-64d401c9ae15 tempest-CinderUnicodeTest-1203001551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d944f278-acfa-4665-b151-8c8772d5a591" returned: 0 in 0.429s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e991aa4f-3293-4762-a0a4-64d401c9ae15 tempest-CinderUnicodeTest-1203001551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d944f278-acfa-4665-b151-8c8772d5a591 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:08 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d944f278-acfa-4665-b151-8c8772d5a591 Jul 17 19:51:08 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:08 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e991aa4f-3293-4762-a0a4-64d401c9ae15 tempest-CinderUnicodeTest-1203001551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d944f278-acfa-4665-b151-8c8772d5a591" returned: 0 in 0.262s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:08 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e991aa4f-3293-4762-a0a4-64d401c9ae15 tempest-CinderUnicodeTest-1203001551 None] Lock "cinder-quobyte-d944f278-acfa-4665-b151-8c8772d5a591" released by "delete_volume" :: held 0.741s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:51:08 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-e991aa4f-3293-4762-a0a4-64d401c9ae15 tempest-CinderUnicodeTest-1203001551 None] Created reservations ['03f8c334-c232-42b3-9f86-9458c936ae8c', '82a062c9-08b5-4b71-89e3-5f42283a2ec1', 'fa49d76f-863b-4cc5-b6f4-8c2f57c1f766', '80b5a5ae-85d9-49bd-acb3-1c13eba71242'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:51:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e991aa4f-3293-4762-a0a4-64d401c9ae15 tempest-CinderUnicodeTest-1203001551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:51:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e991aa4f-3293-4762-a0a4-64d401c9ae15 tempest-CinderUnicodeTest-1203001551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:51:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e991aa4f-3293-4762-a0a4-64d401c9ae15 tempest-CinderUnicodeTest-1203001551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:51:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e991aa4f-3293-4762-a0a4-64d401c9ae15 tempest-CinderUnicodeTest-1203001551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:51:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e991aa4f-3293-4762-a0a4-64d401c9ae15 tempest-CinderUnicodeTest-1203001551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:51:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e991aa4f-3293-4762-a0a4-64d401c9ae15 tempest-CinderUnicodeTest-1203001551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:08 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:51:08 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:09 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=142,cinder:UPDATE=175,cinder:DELETE=16,cinder:INSERT=38 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e991aa4f-3293-4762-a0a4-64d401c9ae15 tempest-CinderUnicodeTest-1203001551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.384s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-e991aa4f-3293-4762-a0a4-64d401c9ae15 tempest-CinderUnicodeTest-1203001551 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:51:09 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e991aa4f-3293-4762-a0a4-64d401c9ae15 tempest-CinderUnicodeTest-1203001551 None] Deleted volume successfully. Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=140,cinder:INSERT=54,cinder:UPDATE=187,cinder:DELETE=17 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e991aa4f-3293-4762-a0a4-64d401c9ae15 tempest-CinderUnicodeTest-1203001551 None] Lock "cinder-d944f278-acfa-4665-b151-8c8772d5a591-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Flow 'volume_create_manager' (988b8e3a-6913-4e00-b13f-2d3e42839058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d674731d-391b-43aa-85b5-0ec15ee842f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d674731d-391b-43aa-85b5-0ec15ee842f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-54502817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b07aef87-df53-4b2d-a90b-94a89521767a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe9d6a4191d404fbfcf2c29db2c68de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=48f08360-d265-4cf0-9217-96443e4f0827,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:51:09Z,use_quota=True,user_id='81dd39e1f1a846b6881c5cafd60204d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16cdd8e-32bb-4161-9315-6349bc51a5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16cdd8e-32bb-4161-9315-6349bc51a5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96432312-9cf9-447d-bd72-5cd7530b1832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96432312-9cf9-447d-bd72-5cd7530b1832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b07aef87-df53-4b2d-a90b-94a89521767a', 'volume_name': 'volume-b07aef87-df53-4b2d-a90b-94a89521767a', 'volume_size': 1, 'snapshot_id': '48f08360-d265-4cf0-9217-96443e4f0827'}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f49618-8919-44d3-8064-6dca26a4d205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f49618-8919-44d3-8064-6dca26a4d205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62ea5f39-f680-424e-a0e8-ee8fb72efc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:51:09 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Volume b07aef87-df53-4b2d-a90b-94a89521767a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b07aef87-df53-4b2d-a90b-94a89521767a', 'volume_size': 1, 'snapshot_id': '48f08360-d265-4cf0-9217-96443e4f0827'} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Acquiring lock "cinder-quobyte-48f08360-d265-4cf0-9217-96443e4f0827-b07aef87-df53-4b2d-a90b-94a89521767a" by "_create_volume_from_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Lock "cinder-quobyte-48f08360-d265-4cf0-9217-96443e4f0827-b07aef87-df53-4b2d-a90b-94a89521767a" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Creating volume b07aef87-df53-4b2d-a90b-94a89521767a from snapshot 48f08360-d265-4cf0-9217-96443e4f0827 {{(pid=87726) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Acquiring lock "cinder-quobyte-b07aef87-df53-4b2d-a90b-94a89521767a" by "_copy_volume_from_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Lock "cinder-quobyte-b07aef87-df53-4b2d-a90b-94a89521767a" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] snapshot: 48f08360-d265-4cf0-9217-96443e4f0827, volume: b07aef87-df53-4b2d-a90b-94a89521767a, {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[6027f2e9-c2a1-43d5-8169-d0a9d29b6470]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90.48f08360-d265-4cf0-9217-96443e4f0827 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:09 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90.48f08360-d265-4cf0-9217-96443e4f0827 Jul 17 19:51:09 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:09 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90.48f08360-d265-4cf0-9217-96443e4f0827" returned: 0 in 0.508s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90 {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Creating direct copy from snapshot {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d25dab7-f099-479f-b4d1-e8513cb76e5a]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:51:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:10 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90 Jul 17 19:51:10 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:10 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90" returned: 0 in 0.546s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:10 devstack cinder-volume[87726]: DEBUG cinder.utils [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Path /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b07aef87-df53-4b2d-a90b-94a89521767a not found in is_blk_device check {{(pid=87726) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 19:51:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b07aef87-df53-4b2d-a90b-94a89521767a {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:10 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b07aef87-df53-4b2d-a90b-94a89521767a Jul 17 19:51:10 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-be8b637c-6381-474e-991f-09d22359458c req-0b75974c-e1ed-4790-91fe-7bbb799578a8 tempest-TestInstancesWithCinderVolumes-1339807416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:51:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:51:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:51:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:51:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:51:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:51:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:51:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:15 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:51:15 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:16 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.790s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:16 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:51:16 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager._thread_info {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:51:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread count: 28 {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 19:51:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread info: [<_MainThread(MainThread, started 130066227544192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 19:51:17 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b07aef87-df53-4b2d-a90b-94a89521767a" returned: 0 in 6.916s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:17 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a331bce-eb65-4b75-a95b-713491b6cfcd]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:51:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:17 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90 Jul 17 19:51:17 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:18 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90" returned: 0 in 0.827s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:18 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Image conversion details: src /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90, size 1024.00 MB, duration 6.92 sec, destination /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b07aef87-df53-4b2d-a90b-94a89521767a {{(pid=87726) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 19:51:18 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Converted 1024.00 MB image at 148.03 MB/s Jul 17 19:51:18 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b07aef87-df53-4b2d-a90b-94a89521767a is being set with open permissions: ugo+rw Jul 17 19:51:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b07aef87-df53-4b2d-a90b-94a89521767a {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:18 devstack sudo[102710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b07aef87-df53-4b2d-a90b-94a89521767a Jul 17 19:51:18 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:18 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b07aef87-df53-4b2d-a90b-94a89521767a" returned: 0 in 0.380s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:18 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Lock "cinder-quobyte-b07aef87-df53-4b2d-a90b-94a89521767a" released by "_copy_volume_from_snapshot" :: held 9.306s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:51:18 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Lock "cinder-quobyte-48f08360-d265-4cf0-9217-96443e4f0827-b07aef87-df53-4b2d-a90b-94a89521767a" released by "_create_volume_from_snapshot" :: held 9.346s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:51:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.362s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:51:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-be8b637c-6381-474e-991f-09d22359458c req-0b75974c-e1ed-4790-91fe-7bbb799578a8 tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.529s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:51:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-be8b637c-6381-474e-991f-09d22359458c req-0b75974c-e1ed-4790-91fe-7bbb799578a8 tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:51:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62ea5f39-f680-424e-a0e8-ee8fb72efc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b07aef87-df53-4b2d-a90b-94a89521767a', 'volume_size': 1, 'snapshot_id': '48f08360-d265-4cf0-9217-96443e4f0827'}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:51:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde3e161-62aa-4609-a9c0-d9a24846529d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:51:18 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Volume volume-b07aef87-df53-4b2d-a90b-94a89521767a (b07aef87-df53-4b2d-a90b-94a89521767a): created successfully Jul 17 19:51:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde3e161-62aa-4609-a9c0-d9a24846529d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:51:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Flow 'volume_create_manager' (988b8e3a-6913-4e00-b13f-2d3e42839058) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:51:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-be8b637c-6381-474e-991f-09d22359458c req-0b75974c-e1ed-4790-91fe-7bbb799578a8 tempest-TestInstancesWithCinderVolumes-1339807416 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55', 'name': 'volume-212f70af-a8fa-4b3e-acd4-3b33a2947d91', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '47bcf16b-856c-44b6-afa5-5679ed31c3d3', 'enforce_multipath': True} {{(pid=87726) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 19:51:18 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-0a941cb6-1f83-4f1c-a0b6-461484ce6113 tempest-TestStampPattern-1595853218 None] Created volume successfully. Jul 17 19:51:18 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-be8b637c-6381-474e-991f-09d22359458c req-0b75974c-e1ed-4790-91fe-7bbb799578a8 tempest-TestInstancesWithCinderVolumes-1339807416 None] attachment_update completed successfully. Jul 17 19:51:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-7d2c6e05-5eb1-4814-9d84-632e66bbb568 req-814eb925-b403-44ee-b41b-2441f0b282e9 tempest-TestInstancesWithCinderVolumes-1339807416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:51:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-7d2c6e05-5eb1-4814-9d84-632e66bbb568 req-814eb925-b403-44ee-b41b-2441f0b282e9 tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:51:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-7d2c6e05-5eb1-4814-9d84-632e66bbb568 req-814eb925-b403-44ee-b41b-2441f0b282e9 tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:51:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-7d2c6e05-5eb1-4814-9d84-632e66bbb568 req-814eb925-b403-44ee-b41b-2441f0b282e9 tempest-TestInstancesWithCinderVolumes-1339807416 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55', 'name': 'volume-8961794a-495c-44d3-9a62-20642ab3ce6c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '68d1fe63-a25f-4042-b1fb-881d7d531b77', 'enforce_multipath': True} {{(pid=87726) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 19:51:22 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-7d2c6e05-5eb1-4814-9d84-632e66bbb568 req-814eb925-b403-44ee-b41b-2441f0b282e9 tempest-TestInstancesWithCinderVolumes-1339807416 None] attachment_update completed successfully. Jul 17 19:51:27 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-c4310d56-e8bc-42ae-8948-e792213144f0 req-88a28f8b-93b2-48ba-94da-71b848d251ce tempest-TestInstancesWithCinderVolumes-1339807416 None] Terminate volume connection completed successfully. Jul 17 19:51:27 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-c4310d56-e8bc-42ae-8948-e792213144f0 req-88a28f8b-93b2-48ba-94da-71b848d251ce tempest-TestInstancesWithCinderVolumes-1339807416 None] Deleting attachment 47bcf16b-856c-44b6-afa5-5679ed31c3d3. {{(pid=87726) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 19:51:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5f86190a-bc67-4e4a-8b0e-37c5e326b767 tempest-TestInstancesWithCinderVolumes-1339807416 None] Acquiring lock "cinder-212f70af-a8fa-4b3e-acd4-3b33a2947d91-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:51:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5f86190a-bc67-4e4a-8b0e-37c5e326b767 tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "cinder-212f70af-a8fa-4b3e-acd4-3b33a2947d91-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:51:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5f86190a-bc67-4e4a-8b0e-37c5e326b767 tempest-TestInstancesWithCinderVolumes-1339807416 None] Acquiring lock "cinder-quobyte-212f70af-a8fa-4b3e-acd4-3b33a2947d91" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:51:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5f86190a-bc67-4e4a-8b0e-37c5e326b767 tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "cinder-quobyte-212f70af-a8fa-4b3e-acd4-3b33a2947d91" acquired by "delete_volume" :: waited 0.015s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:51:28 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[38442154-0f2f-4032-ab26-97d37e007e88]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:51:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5f86190a-bc67-4e4a-8b0e-37c5e326b767 tempest-TestInstancesWithCinderVolumes-1339807416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-212f70af-a8fa-4b3e-acd4-3b33a2947d91 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:28 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-212f70af-a8fa-4b3e-acd4-3b33a2947d91 Jul 17 19:51:28 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:28 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5f86190a-bc67-4e4a-8b0e-37c5e326b767 tempest-TestInstancesWithCinderVolumes-1339807416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-212f70af-a8fa-4b3e-acd4-3b33a2947d91" returned: 0 in 0.402s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5f86190a-bc67-4e4a-8b0e-37c5e326b767 tempest-TestInstancesWithCinderVolumes-1339807416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-212f70af-a8fa-4b3e-acd4-3b33a2947d91 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:28 devstack sudo[102843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-212f70af-a8fa-4b3e-acd4-3b33a2947d91 Jul 17 19:51:28 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:28 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5f86190a-bc67-4e4a-8b0e-37c5e326b767 tempest-TestInstancesWithCinderVolumes-1339807416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-212f70af-a8fa-4b3e-acd4-3b33a2947d91" returned: 0 in 0.287s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5f86190a-bc67-4e4a-8b0e-37c5e326b767 tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "cinder-quobyte-212f70af-a8fa-4b3e-acd4-3b33a2947d91" released by "delete_volume" :: held 0.737s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:51:28 devstack cinder-volume[87726]: WARNING cinder.quota [None req-5f86190a-bc67-4e4a-8b0e-37c5e326b767 tempest-TestInstancesWithCinderVolumes-1339807416 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1070612473-119601519 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1070612473-119601519, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:51:28 devstack cinder-volume[87726]: WARNING cinder.quota [None req-5f86190a-bc67-4e4a-8b0e-37c5e326b767 tempest-TestInstancesWithCinderVolumes-1339807416 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1070612473-119601519 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1070612473-119601519, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:51:28 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-5f86190a-bc67-4e4a-8b0e-37c5e326b767 tempest-TestInstancesWithCinderVolumes-1339807416 None] Created reservations ['64467b88-db73-48e2-8709-dc4707c2c01b', '13ee613f-1dac-4481-85bb-deccb4432422', 'f6bcc927-3f08-4c0d-abaf-ede965a83d9a', '41bdc8c0-620a-4339-b2f5-8a5b529abd92'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:51:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5f86190a-bc67-4e4a-8b0e-37c5e326b767 tempest-TestInstancesWithCinderVolumes-1339807416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:51:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5f86190a-bc67-4e4a-8b0e-37c5e326b767 tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:51:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5f86190a-bc67-4e4a-8b0e-37c5e326b767 tempest-TestInstancesWithCinderVolumes-1339807416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:51:28 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5f86190a-bc67-4e4a-8b0e-37c5e326b767 tempest-TestInstancesWithCinderVolumes-1339807416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:51:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5f86190a-bc67-4e4a-8b0e-37c5e326b767 tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:51:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5f86190a-bc67-4e4a-8b0e-37c5e326b767 tempest-TestInstancesWithCinderVolumes-1339807416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:29 devstack sudo[102846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:51:29 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:29 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5f86190a-bc67-4e4a-8b0e-37c5e326b767 tempest-TestInstancesWithCinderVolumes-1339807416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.272s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:29 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-5f86190a-bc67-4e4a-8b0e-37c5e326b767 tempest-TestInstancesWithCinderVolumes-1339807416 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:51:29 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-5f86190a-bc67-4e4a-8b0e-37c5e326b767 tempest-TestInstancesWithCinderVolumes-1339807416 None] Deleted volume successfully. Jul 17 19:51:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5f86190a-bc67-4e4a-8b0e-37c5e326b767 tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "cinder-212f70af-a8fa-4b3e-acd4-3b33a2947d91-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:51:31 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-e353025e-7982-419c-9067-66be36adb04a req-4a37425c-2852-462c-aa28-adaed5385ac9 tempest-TestInstancesWithCinderVolumes-1339807416 None] Terminate volume connection completed successfully. Jul 17 19:51:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-e353025e-7982-419c-9067-66be36adb04a req-4a37425c-2852-462c-aa28-adaed5385ac9 tempest-TestInstancesWithCinderVolumes-1339807416 None] Deleting attachment 68d1fe63-a25f-4042-b1fb-881d7d531b77. {{(pid=87726) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 19:51:32 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-75824867-4e2f-419e-8cb5-52b6a2393164 tempest-TestInstancesWithCinderVolumes-1339807416 None] Acquiring lock "cinder-8961794a-495c-44d3-9a62-20642ab3ce6c-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:51:32 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-75824867-4e2f-419e-8cb5-52b6a2393164 tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "cinder-8961794a-495c-44d3-9a62-20642ab3ce6c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:51:32 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-75824867-4e2f-419e-8cb5-52b6a2393164 tempest-TestInstancesWithCinderVolumes-1339807416 None] Acquiring lock "cinder-quobyte-8961794a-495c-44d3-9a62-20642ab3ce6c" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:51:32 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-75824867-4e2f-419e-8cb5-52b6a2393164 tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "cinder-quobyte-8961794a-495c-44d3-9a62-20642ab3ce6c" acquired by "delete_volume" :: waited 0.024s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:51:32 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0425c04-c5ce-48de-84c3-0e92db73adad]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:51:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-75824867-4e2f-419e-8cb5-52b6a2393164 tempest-TestInstancesWithCinderVolumes-1339807416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8961794a-495c-44d3-9a62-20642ab3ce6c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:32 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8961794a-495c-44d3-9a62-20642ab3ce6c Jul 17 19:51:32 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:33 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-75824867-4e2f-419e-8cb5-52b6a2393164 tempest-TestInstancesWithCinderVolumes-1339807416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8961794a-495c-44d3-9a62-20642ab3ce6c" returned: 0 in 0.411s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-75824867-4e2f-419e-8cb5-52b6a2393164 tempest-TestInstancesWithCinderVolumes-1339807416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8961794a-495c-44d3-9a62-20642ab3ce6c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:33 devstack sudo[102882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8961794a-495c-44d3-9a62-20642ab3ce6c Jul 17 19:51:33 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:33 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-75824867-4e2f-419e-8cb5-52b6a2393164 tempest-TestInstancesWithCinderVolumes-1339807416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8961794a-495c-44d3-9a62-20642ab3ce6c" returned: 0 in 0.308s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:33 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-75824867-4e2f-419e-8cb5-52b6a2393164 tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "cinder-quobyte-8961794a-495c-44d3-9a62-20642ab3ce6c" released by "delete_volume" :: held 0.788s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:51:33 devstack cinder-volume[87726]: WARNING cinder.quota [None req-75824867-4e2f-419e-8cb5-52b6a2393164 tempest-TestInstancesWithCinderVolumes-1339807416 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1073791852-153375243 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1073791852-153375243, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:51:33 devstack cinder-volume[87726]: WARNING cinder.quota [None req-75824867-4e2f-419e-8cb5-52b6a2393164 tempest-TestInstancesWithCinderVolumes-1339807416 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1073791852-153375243 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1073791852-153375243, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:51:33 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-75824867-4e2f-419e-8cb5-52b6a2393164 tempest-TestInstancesWithCinderVolumes-1339807416 None] Created reservations ['2c8ed66b-dba6-4ef7-a9c5-67b3e302016c', '3366b02c-ee70-4dec-83d4-592c71029296', 'cdd35a07-ae7c-4e3d-a8cf-56c5560541bc', 'b9570dea-7bac-4a95-9d95-e7edfe12f389'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:51:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-75824867-4e2f-419e-8cb5-52b6a2393164 tempest-TestInstancesWithCinderVolumes-1339807416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:51:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-75824867-4e2f-419e-8cb5-52b6a2393164 tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:51:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-75824867-4e2f-419e-8cb5-52b6a2393164 tempest-TestInstancesWithCinderVolumes-1339807416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:51:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-75824867-4e2f-419e-8cb5-52b6a2393164 tempest-TestInstancesWithCinderVolumes-1339807416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:51:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-75824867-4e2f-419e-8cb5-52b6a2393164 tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:51:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-75824867-4e2f-419e-8cb5-52b6a2393164 tempest-TestInstancesWithCinderVolumes-1339807416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:33 devstack sudo[102896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:51:33 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:33 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-75824867-4e2f-419e-8cb5-52b6a2393164 tempest-TestInstancesWithCinderVolumes-1339807416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.285s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:33 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-75824867-4e2f-419e-8cb5-52b6a2393164 tempest-TestInstancesWithCinderVolumes-1339807416 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:51:33 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-75824867-4e2f-419e-8cb5-52b6a2393164 tempest-TestInstancesWithCinderVolumes-1339807416 None] Deleted volume successfully. Jul 17 19:51:33 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-75824867-4e2f-419e-8cb5-52b6a2393164 tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "cinder-8961794a-495c-44d3-9a62-20642ab3ce6c-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:51:36 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-e95604a8-58ae-4ba8-9128-afdf9fd01503 req-1fd77dd0-3e99-4fc3-97ec-98bdf9745017 tempest-TestInstancesWithCinderVolumes-1339807416 None] Terminate volume connection completed successfully. Jul 17 19:51:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-e95604a8-58ae-4ba8-9128-afdf9fd01503 req-1fd77dd0-3e99-4fc3-97ec-98bdf9745017 tempest-TestInstancesWithCinderVolumes-1339807416 None] Deleting attachment 8413f568-93e1-49d6-9fd9-1f2a1e412f41. {{(pid=87726) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 19:51:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-92bcc3c2-2587-400e-9e37-9df2e88cea62 tempest-TestInstancesWithCinderVolumes-1339807416 None] Acquiring lock "cinder-6b853b5f-9273-432f-9338-c33acd74c3a7-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:51:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-92bcc3c2-2587-400e-9e37-9df2e88cea62 tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "cinder-6b853b5f-9273-432f-9338-c33acd74c3a7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:51:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-92bcc3c2-2587-400e-9e37-9df2e88cea62 tempest-TestInstancesWithCinderVolumes-1339807416 None] Acquiring lock "cinder-quobyte-6b853b5f-9273-432f-9338-c33acd74c3a7" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:51:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-92bcc3c2-2587-400e-9e37-9df2e88cea62 tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "cinder-quobyte-6b853b5f-9273-432f-9338-c33acd74c3a7" acquired by "delete_volume" :: waited 0.014s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:51:37 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[39317832-f535-41cc-ade8-4097d794a5d7]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:51:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-92bcc3c2-2587-400e-9e37-9df2e88cea62 tempest-TestInstancesWithCinderVolumes-1339807416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b853b5f-9273-432f-9338-c33acd74c3a7 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:37 devstack sudo[102926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b853b5f-9273-432f-9338-c33acd74c3a7 Jul 17 19:51:37 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:38 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-92bcc3c2-2587-400e-9e37-9df2e88cea62 tempest-TestInstancesWithCinderVolumes-1339807416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b853b5f-9273-432f-9338-c33acd74c3a7" returned: 0 in 0.347s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-92bcc3c2-2587-400e-9e37-9df2e88cea62 tempest-TestInstancesWithCinderVolumes-1339807416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b853b5f-9273-432f-9338-c33acd74c3a7 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:38 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b853b5f-9273-432f-9338-c33acd74c3a7 Jul 17 19:51:38 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:38 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-92bcc3c2-2587-400e-9e37-9df2e88cea62 tempest-TestInstancesWithCinderVolumes-1339807416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6b853b5f-9273-432f-9338-c33acd74c3a7" returned: 0 in 0.247s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:38 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-92bcc3c2-2587-400e-9e37-9df2e88cea62 tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "cinder-quobyte-6b853b5f-9273-432f-9338-c33acd74c3a7" released by "delete_volume" :: held 0.632s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:51:38 devstack cinder-volume[87726]: WARNING cinder.quota [None req-92bcc3c2-2587-400e-9e37-9df2e88cea62 tempest-TestInstancesWithCinderVolumes-1339807416 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-912871274-769336920 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-912871274-769336920, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:51:38 devstack cinder-volume[87726]: WARNING cinder.quota [None req-92bcc3c2-2587-400e-9e37-9df2e88cea62 tempest-TestInstancesWithCinderVolumes-1339807416 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-912871274-769336920 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-912871274-769336920, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:51:38 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-92bcc3c2-2587-400e-9e37-9df2e88cea62 tempest-TestInstancesWithCinderVolumes-1339807416 None] Created reservations ['d0ca330b-b3ac-42a6-a2f1-151c0d669119', '7859b1c1-2a3e-44a5-9f10-988b4754c338', '59d5bb35-2fc8-4c26-9dec-4cf58a835a0d', 'c7b4c9fc-e395-491e-991e-2d910fa8a249'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:51:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-92bcc3c2-2587-400e-9e37-9df2e88cea62 tempest-TestInstancesWithCinderVolumes-1339807416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:51:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-92bcc3c2-2587-400e-9e37-9df2e88cea62 tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:51:38 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-92bcc3c2-2587-400e-9e37-9df2e88cea62 tempest-TestInstancesWithCinderVolumes-1339807416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:51:38 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-92bcc3c2-2587-400e-9e37-9df2e88cea62 tempest-TestInstancesWithCinderVolumes-1339807416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:51:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-92bcc3c2-2587-400e-9e37-9df2e88cea62 tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:51:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-92bcc3c2-2587-400e-9e37-9df2e88cea62 tempest-TestInstancesWithCinderVolumes-1339807416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:51:38 devstack sudo[102934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:51:38 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:51:38 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root Jul 17 19:51:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-92bcc3c2-2587-400e-9e37-9df2e88cea62 tempest-TestInstancesWithCinderVolumes-1339807416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.243s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:51:38 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-92bcc3c2-2587-400e-9e37-9df2e88cea62 tempest-TestInstancesWithCinderVolumes-1339807416 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:51:38 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-92bcc3c2-2587-400e-9e37-9df2e88cea62 tempest-TestInstancesWithCinderVolumes-1339807416 None] Deleted volume successfully. Jul 17 19:51:38 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-92bcc3c2-2587-400e-9e37-9df2e88cea62 tempest-TestInstancesWithCinderVolumes-1339807416 None] Lock "cinder-6b853b5f-9273-432f-9338-c33acd74c3a7-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:51:48 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=34,cinder:UPDATE=38,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:51:48 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:UPDATE=20,cinder:SELECT=32,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:52:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-2b6c2a26-e46f-4b86-95ba-51e2dfa24264 req-f975f2be-f153-40e5-8cee-a29cfe5e5eae tempest-TestStampPattern-1595853218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:52:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-2b6c2a26-e46f-4b86-95ba-51e2dfa24264 req-f975f2be-f153-40e5-8cee-a29cfe5e5eae tempest-TestStampPattern-1595853218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:52:01 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54e2484-cca7-4a70-b95f-45aa78104538]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:52:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-2b6c2a26-e46f-4b86-95ba-51e2dfa24264 req-f975f2be-f153-40e5-8cee-a29cfe5e5eae tempest-TestStampPattern-1595853218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b07aef87-df53-4b2d-a90b-94a89521767a {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:01 devstack sudo[103004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b07aef87-df53-4b2d-a90b-94a89521767a Jul 17 19:52:01 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:02 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-2b6c2a26-e46f-4b86-95ba-51e2dfa24264 req-f975f2be-f153-40e5-8cee-a29cfe5e5eae tempest-TestStampPattern-1595853218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b07aef87-df53-4b2d-a90b-94a89521767a" returned: 0 in 0.397s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-2b6c2a26-e46f-4b86-95ba-51e2dfa24264 req-f975f2be-f153-40e5-8cee-a29cfe5e5eae tempest-TestStampPattern-1595853218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.442s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:52:02 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-2b6c2a26-e46f-4b86-95ba-51e2dfa24264 req-f975f2be-f153-40e5-8cee-a29cfe5e5eae tempest-TestStampPattern-1595853218 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55', 'name': 'volume-b07aef87-df53-4b2d-a90b-94a89521767a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'db899875-f24a-46ab-bf16-76ff66bb8f34', 'enforce_multipath': True} {{(pid=87726) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 19:52:02 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-2b6c2a26-e46f-4b86-95ba-51e2dfa24264 req-f975f2be-f153-40e5-8cee-a29cfe5e5eae tempest-TestStampPattern-1595853218 None] attachment_update completed successfully. Jul 17 19:52:05 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-b30a3fe5-9fb7-4b8a-95e3-3a32816cbe4d req-0ee33cf8-5106-41ae-9c03-a22ae5bd79c1 tempest-TestStampPattern-1595853218 None] Terminate volume connection completed successfully. Jul 17 19:52:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-b30a3fe5-9fb7-4b8a-95e3-3a32816cbe4d req-0ee33cf8-5106-41ae-9c03-a22ae5bd79c1 tempest-TestStampPattern-1595853218 None] Deleting attachment db899875-f24a-46ab-bf16-76ff66bb8f34. {{(pid=87726) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 19:52:09 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e3b551c5-2b88-4c9c-a12b-3019ff76c36a tempest-TestStampPattern-1595853218 None] Acquiring lock "cinder-b07aef87-df53-4b2d-a90b-94a89521767a-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:52:09 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e3b551c5-2b88-4c9c-a12b-3019ff76c36a tempest-TestStampPattern-1595853218 None] Lock "cinder-b07aef87-df53-4b2d-a90b-94a89521767a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:52:09 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e3b551c5-2b88-4c9c-a12b-3019ff76c36a tempest-TestStampPattern-1595853218 None] Acquiring lock "cinder-quobyte-b07aef87-df53-4b2d-a90b-94a89521767a" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:52:09 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e3b551c5-2b88-4c9c-a12b-3019ff76c36a tempest-TestStampPattern-1595853218 None] Lock "cinder-quobyte-b07aef87-df53-4b2d-a90b-94a89521767a" acquired by "delete_volume" :: waited 0.016s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:52:09 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c535e3-e8ce-4680-9596-4bad867c466c]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:52:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3b551c5-2b88-4c9c-a12b-3019ff76c36a tempest-TestStampPattern-1595853218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b07aef87-df53-4b2d-a90b-94a89521767a {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:09 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b07aef87-df53-4b2d-a90b-94a89521767a Jul 17 19:52:09 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:10 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3b551c5-2b88-4c9c-a12b-3019ff76c36a tempest-TestStampPattern-1595853218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b07aef87-df53-4b2d-a90b-94a89521767a" returned: 0 in 0.413s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3b551c5-2b88-4c9c-a12b-3019ff76c36a tempest-TestStampPattern-1595853218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b07aef87-df53-4b2d-a90b-94a89521767a {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:10 devstack sudo[103467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b07aef87-df53-4b2d-a90b-94a89521767a Jul 17 19:52:10 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:10 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:52:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Flow 'volume_create_manager' (6e1a6a9b-1195-493c-8814-bdfe329c6d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:52:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (053ade8d-309a-474f-bbfa-3a4827199e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:52:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (053ade8d-309a-474f-bbfa-3a4827199e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-761823443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb5d3b0-995e-4830-b099-f03042fc6c12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3048812070b4a8792739287d92149a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:52:10Z,use_quota=True,user_id='ec56d702da314830a8b5d26a4e5f159c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:52:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1837b777-4d8b-48e0-9199-cdd7cbe66cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:52:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1837b777-4d8b-48e0-9199-cdd7cbe66cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:52:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1038eb5-fe2c-4e81-8f84-37a356268ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:52:10 devstack cinder-volume[87726]: DEBUG cinder.image.glance [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Creating Keystone auth plugin from conf {{(pid=87726) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 19:52:10 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3b551c5-2b88-4c9c-a12b-3019ff76c36a tempest-TestStampPattern-1595853218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b07aef87-df53-4b2d-a90b-94a89521767a" returned: 0 in 0.265s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e3b551c5-2b88-4c9c-a12b-3019ff76c36a tempest-TestStampPattern-1595853218 None] Lock "cinder-quobyte-b07aef87-df53-4b2d-a90b-94a89521767a" released by "delete_volume" :: held 0.727s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:52:10 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-e3b551c5-2b88-4c9c-a12b-3019ff76c36a tempest-TestStampPattern-1595853218 None] Created reservations ['e4d1db5e-8f95-46f7-820b-e553e6f4f7ef', 'a02b3169-3362-49f9-816f-dde1a561bb34', '7eaf870e-1175-471c-83bf-9ad2fd23a734', '350eff1a-07e4-4b14-937e-7b2e127b7de2'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:52:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e3b551c5-2b88-4c9c-a12b-3019ff76c36a tempest-TestStampPattern-1595853218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:52:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e3b551c5-2b88-4c9c-a12b-3019ff76c36a tempest-TestStampPattern-1595853218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:52:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e3b551c5-2b88-4c9c-a12b-3019ff76c36a tempest-TestStampPattern-1595853218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:52:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e3b551c5-2b88-4c9c-a12b-3019ff76c36a tempest-TestStampPattern-1595853218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:52:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e3b551c5-2b88-4c9c-a12b-3019ff76c36a tempest-TestStampPattern-1595853218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:52:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3b551c5-2b88-4c9c-a12b-3019ff76c36a tempest-TestStampPattern-1595853218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:10 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:52:10 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1038eb5-fe2c-4e81-8f84-37a356268ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bcb5d3b0-995e-4830-b099-f03042fc6c12', 'volume_name': 'volume-bcb5d3b0-995e-4830-b099-f03042fc6c12', 'volume_size': 1, 'image_id': '8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f9f36413d75c4b9e8be9b78b4ce9c162', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'created_at': datetime.datetime(2026, 7, 17, 17, 31, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 17, 31, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:52:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624d1166-dcc0-4900-9ed4-29092644c1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:52:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624d1166-dcc0-4900-9ed4-29092644c1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:52:10 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0edb8c35-5cc5-4644-b4a8-399e5d97e0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:52:10 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Volume bcb5d3b0-995e-4830-b099-f03042fc6c12: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bcb5d3b0-995e-4830-b099-f03042fc6c12', 'volume_size': 1, 'image_id': '8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f9f36413d75c4b9e8be9b78b4ce9c162', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'created_at': datetime.datetime(2026, 7, 17, 17, 31, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 17, 31, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 17 19:52:10 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Trying to clone bcb5d3b0-995e-4830-b099-f03042fc6c12 from image 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'metadata': {}}]). {{(pid=87726) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 19:52:10 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3b551c5-2b88-4c9c-a12b-3019ff76c36a tempest-TestStampPattern-1595853218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.285s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:10 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-e3b551c5-2b88-4c9c-a12b-3019ff76c36a tempest-TestStampPattern-1595853218 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:52:11 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e3b551c5-2b88-4c9c-a12b-3019ff76c36a tempest-TestStampPattern-1595853218 None] Deleted volume successfully. Jul 17 19:52:11 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e3b551c5-2b88-4c9c-a12b-3019ff76c36a tempest-TestStampPattern-1595853218 None] Lock "cinder-b07aef87-df53-4b2d-a90b-94a89521767a-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:52:11 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_uhjsy4w7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87726) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 19:52:11 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Image download 20.69 MB at 20.69 MB/s Jul 17 19:52:11 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9df412-cee2-4830-a779-4219fbe099d4]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:52:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_uhjsy4w7devstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:11 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99437ad1-0a1d-46a0-9af2-4a34d7a21d0e tempest-TestStampPattern-1595853218 None] Acquiring lock "cinder-48f08360-d265-4cf0-9217-96443e4f0827-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:52:11 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99437ad1-0a1d-46a0-9af2-4a34d7a21d0e tempest-TestStampPattern-1595853218 None] Lock "cinder-48f08360-d265-4cf0-9217-96443e4f0827-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:52:11 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99437ad1-0a1d-46a0-9af2-4a34d7a21d0e tempest-TestStampPattern-1595853218 None] Acquiring lock "cinder-quobyte-98dbaed7-0773-4d32-b9c5-04b0eaaffd90" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:52:11 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99437ad1-0a1d-46a0-9af2-4a34d7a21d0e tempest-TestStampPattern-1595853218 None] Lock "cinder-quobyte-98dbaed7-0773-4d32-b9c5-04b0eaaffd90" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:52:11 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99437ad1-0a1d-46a0-9af2-4a34d7a21d0e tempest-TestStampPattern-1595853218 None] Acquiring lock "cinder-quobyte-48f08360-d265-4cf0-9217-96443e4f0827" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:52:11 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99437ad1-0a1d-46a0-9af2-4a34d7a21d0e tempest-TestStampPattern-1595853218 None] Lock "cinder-quobyte-48f08360-d265-4cf0-9217-96443e4f0827" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:52:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-99437ad1-0a1d-46a0-9af2-4a34d7a21d0e tempest-TestStampPattern-1595853218 None] Deleting offline snapshot 48f08360-d265-4cf0-9217-96443e4f0827 of volume 98dbaed7-0773-4d32-b9c5-04b0eaaffd90 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:52:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-99437ad1-0a1d-46a0-9af2-4a34d7a21d0e tempest-TestStampPattern-1595853218 None] snapshot_file for this snap is: volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90.48f08360-d265-4cf0-9217-96443e4f0827 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:52:11 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4b1113-8e3a-46da-8c5c-3ec5f95819d3]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:52:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99437ad1-0a1d-46a0-9af2-4a34d7a21d0e tempest-TestStampPattern-1595853218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90.48f08360-d265-4cf0-9217-96443e4f0827 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:11 devstack sudo[103474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_uhjsy4w7devstack@QuobyteHD Jul 17 19:52:11 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:11 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90.48f08360-d265-4cf0-9217-96443e4f0827 Jul 17 19:52:11 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:11 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_uhjsy4w7devstack@QuobyteHD" returned: 0 in 0.370s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:11 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Temporary image 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 is fetched for user ec56d702da314830a8b5d26a4e5f159c. {{(pid=87726) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 19:52:11 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f98a92-0714-4d86-8df6-a330485922a5]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:52:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_uhjsy4w7devstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:11 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99437ad1-0a1d-46a0-9af2-4a34d7a21d0e tempest-TestStampPattern-1595853218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90.48f08360-d265-4cf0-9217-96443e4f0827" returned: 0 in 0.382s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-99437ad1-0a1d-46a0-9af2-4a34d7a21d0e tempest-TestStampPattern-1595853218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:52:11 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[16caeaf8-71a1-4355-a775-a826df3a59dc]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:52:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99437ad1-0a1d-46a0-9af2-4a34d7a21d0e tempest-TestStampPattern-1595853218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:11 devstack sudo[103483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_uhjsy4w7devstack@QuobyteHD Jul 17 19:52:11 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:11 devstack sudo[103485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90 Jul 17 19:52:11 devstack sudo[103485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:12 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_uhjsy4w7devstack@QuobyteHD" returned: 0 in 0.325s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:52:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:52:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-761823443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb5d3b0-995e-4830-b099-f03042fc6c12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3048812070b4a8792739287d92149a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:52:10Z,use_quota=True,user_id='ec56d702da314830a8b5d26a4e5f159c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:52:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Creating volume bcb5d3b0-995e-4830-b099-f03042fc6c12 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:52:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:52:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:52:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:52:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:52:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:52:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:52:12 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:52:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bcb5d3b0-995e-4830-b099-f03042fc6c12 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:12 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bcb5d3b0-995e-4830-b099-f03042fc6c12 1073741824 Jul 17 19:52:12 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:12 devstack sudo[103485]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99437ad1-0a1d-46a0-9af2-4a34d7a21d0e tempest-TestStampPattern-1595853218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90" returned: 0 in 0.406s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99437ad1-0a1d-46a0-9af2-4a34d7a21d0e tempest-TestStampPattern-1595853218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90.48f08360-d265-4cf0-9217-96443e4f0827 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:12 devstack sudo[103497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90.48f08360-d265-4cf0-9217-96443e4f0827 Jul 17 19:52:12 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:12 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bcb5d3b0-995e-4830-b099-f03042fc6c12 1073741824" returned: 0 in 0.469s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bcb5d3b0-995e-4830-b099-f03042fc6c12 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:12 devstack sudo[103506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bcb5d3b0-995e-4830-b099-f03042fc6c12 Jul 17 19:52:12 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:12 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99437ad1-0a1d-46a0-9af2-4a34d7a21d0e tempest-TestStampPattern-1595853218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90.48f08360-d265-4cf0-9217-96443e4f0827" returned: 0 in 0.400s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99437ad1-0a1d-46a0-9af2-4a34d7a21d0e tempest-TestStampPattern-1595853218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90.48f08360-d265-4cf0-9217-96443e4f0827 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:12 devstack sudo[103508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90.48f08360-d265-4cf0-9217-96443e4f0827 Jul 17 19:52:12 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:12 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bcb5d3b0-995e-4830-b099-f03042fc6c12" returned: 0 in 0.246s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:52:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:52:12 devstack cinder-volume[87726]: DEBUG cinder.volume.volume_utils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Attempting download of 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'metadata': {}}])) to volume bcb5d3b0-995e-4830-b099-f03042fc6c12. {{(pid=87726) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 19:52:12 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:12 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b8194e-379a-4be8-93be-1bb757faf524]: (4, 'raw') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:52:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_da81bgxc {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-99437ad1-0a1d-46a0-9af2-4a34d7a21d0e tempest-TestStampPattern-1595853218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90.48f08360-d265-4cf0-9217-96443e4f0827" returned: 0 in 0.274s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:12 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99437ad1-0a1d-46a0-9af2-4a34d7a21d0e tempest-TestStampPattern-1595853218 None] Lock "cinder-quobyte-48f08360-d265-4cf0-9217-96443e4f0827" released by "_delete_snapshot" :: held 1.568s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:52:12 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99437ad1-0a1d-46a0-9af2-4a34d7a21d0e tempest-TestStampPattern-1595853218 None] Lock "cinder-quobyte-98dbaed7-0773-4d32-b9c5-04b0eaaffd90" released by "delete_snapshot" :: held 1.592s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:52:12 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-99437ad1-0a1d-46a0-9af2-4a34d7a21d0e tempest-TestStampPattern-1595853218 None] Created reservations ['8aee9732-19eb-40d3-914a-583939a21656', 'f0e2465b-fe23-482e-9b58-e335602cf3d2', '8649e3ad-9ed1-4001-a831-9dcf4b4afc62', 'b093f17b-b334-4e48-ada5-6f27105b76f5'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:52:12 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_da81bgxc Jul 17 19:52:12 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:13 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-99437ad1-0a1d-46a0-9af2-4a34d7a21d0e tempest-TestStampPattern-1595853218 None] Delete snapshot completed successfully. Jul 17 19:52:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-99437ad1-0a1d-46a0-9af2-4a34d7a21d0e tempest-TestStampPattern-1595853218 None] Lock "cinder-48f08360-d265-4cf0-9217-96443e4f0827-delete_snapshot" released by "delete_snapshot" :: held 1.723s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:52:13 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_da81bgxc" returned: 0 in 0.334s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_da81bgxc {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:13 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_da81bgxc Jul 17 19:52:13 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:13 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_da81bgxc" returned: 1 in 0.323s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_da81bgxc' failed. Not Retrying. {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 19:52:13 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f7da2c-e7ef-408f-9629-a3acb9d6bcb5]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:52:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_uhjsy4w7devstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:13 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_uhjsy4w7devstack@QuobyteHD Jul 17 19:52:13 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:13 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_uhjsy4w7devstack@QuobyteHD" returned: 0 in 0.341s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:13 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 was qcow2, converting to qcow2 {{(pid=87726) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 19:52:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_uhjsy4w7devstack@QuobyteHD /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bcb5d3b0-995e-4830-b099-f03042fc6c12 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:13 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_uhjsy4w7devstack@QuobyteHD /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bcb5d3b0-995e-4830-b099-f03042fc6c12 Jul 17 19:52:13 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:52:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:52:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:52:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:52:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:52:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:52:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:15 devstack sudo[103559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:52:15 devstack sudo[103559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:15 devstack sudo[103559]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.384s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:15 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:52:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager._thread_info {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:52:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread count: 28 {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 19:52:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread info: [<_MainThread(MainThread, started 130066227544192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 19:52:16 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_uhjsy4w7devstack@QuobyteHD /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bcb5d3b0-995e-4830-b099-f03042fc6c12" returned: 0 in 2.185s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:16 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8e2f5363-0f60-45b4-bd42-3ca5e33637d7_uhjsy4w7devstack@QuobyteHD, size 112.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bcb5d3b0-995e-4830-b099-f03042fc6c12 {{(pid=87726) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 19:52:16 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Converted 112.00 MB image at 51.23 MB/s Jul 17 19:52:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bcb5d3b0-995e-4830-b099-f03042fc6c12 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:16 devstack sudo[103564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bcb5d3b0-995e-4830-b099-f03042fc6c12 1G Jul 17 19:52:16 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:16 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bcb5d3b0-995e-4830-b099-f03042fc6c12 1G" returned: 0 in 0.355s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:16 devstack cinder-volume[87726]: DEBUG cinder.volume.volume_utils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Downloaded image 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'metadata': {}}])) to volume bcb5d3b0-995e-4830-b099-f03042fc6c12 successfully. {{(pid=87726) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 19:52:16 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Temporary image 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 for user ec56d702da314830a8b5d26a4e5f159c is deleted. {{(pid=87726) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 19:52:16 devstack cinder-volume[87726]: DEBUG cinder.volume.volume_utils [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Marking volume bcb5d3b0-995e-4830-b099-f03042fc6c12 as bootable. {{(pid=87726) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 19:52:16 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Copying metadata from image 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 to bcb5d3b0-995e-4830-b099-f03042fc6c12. {{(pid=87726) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 19:52:16 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Creating volume glance metadata for volume bcb5d3b0-995e-4830-b099-f03042fc6c12 backed by image 8e2f5363-0f60-45b4-bd42-3ca5e33637d7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87726) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 19:52:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0edb8c35-5cc5-4644-b4a8-399e5d97e0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcb5d3b0-995e-4830-b099-f03042fc6c12', 'volume_size': 1, 'image_id': '8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f9f36413d75c4b9e8be9b78b4ce9c162', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8e2f5363-0f60-45b4-bd42-3ca5e33637d7', 'created_at': datetime.datetime(2026, 7, 17, 17, 31, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 17, 31, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e2f5363-0f60-45b4-bd42-3ca5e33637d7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:52:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb92c5b2-ddb3-42de-8747-79a74f36bcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:52:16 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Volume volume-bcb5d3b0-995e-4830-b099-f03042fc6c12 (bcb5d3b0-995e-4830-b099-f03042fc6c12): created successfully Jul 17 19:52:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb92c5b2-ddb3-42de-8747-79a74f36bcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:52:16 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Flow 'volume_create_manager' (6e1a6a9b-1195-493c-8814-bdfe329c6d48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:52:16 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-86c55493-b37f-4eaf-b002-0ea9a6c3b8ff tempest-TestShelveInstance-1061568434 None] Created volume successfully. Jul 17 19:52:17 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-71fb9508-322f-43b9-9194-8c70cdcbe9ca tempest-TestStampPattern-1595853218 None] Acquiring lock "cinder-98dbaed7-0773-4d32-b9c5-04b0eaaffd90-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:52:17 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-71fb9508-322f-43b9-9194-8c70cdcbe9ca tempest-TestStampPattern-1595853218 None] Lock "cinder-98dbaed7-0773-4d32-b9c5-04b0eaaffd90-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:52:17 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-71fb9508-322f-43b9-9194-8c70cdcbe9ca tempest-TestStampPattern-1595853218 None] Acquiring lock "cinder-quobyte-98dbaed7-0773-4d32-b9c5-04b0eaaffd90" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:52:17 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-71fb9508-322f-43b9-9194-8c70cdcbe9ca tempest-TestStampPattern-1595853218 None] Lock "cinder-quobyte-98dbaed7-0773-4d32-b9c5-04b0eaaffd90" acquired by "delete_volume" :: waited 0.023s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:52:17 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[64eeb1ef-1167-4196-952b-6337fce6b561]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:52:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-71fb9508-322f-43b9-9194-8c70cdcbe9ca tempest-TestStampPattern-1595853218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:17 devstack sudo[103570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90 Jul 17 19:52:17 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:17 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-71fb9508-322f-43b9-9194-8c70cdcbe9ca tempest-TestStampPattern-1595853218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90" returned: 0 in 0.377s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-71fb9508-322f-43b9-9194-8c70cdcbe9ca tempest-TestStampPattern-1595853218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:17 devstack sudo[103576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90 Jul 17 19:52:17 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:17 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-71fb9508-322f-43b9-9194-8c70cdcbe9ca tempest-TestStampPattern-1595853218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-98dbaed7-0773-4d32-b9c5-04b0eaaffd90" returned: 0 in 0.277s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:17 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-71fb9508-322f-43b9-9194-8c70cdcbe9ca tempest-TestStampPattern-1595853218 None] Lock "cinder-quobyte-98dbaed7-0773-4d32-b9c5-04b0eaaffd90" released by "delete_volume" :: held 0.717s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:52:17 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-71fb9508-322f-43b9-9194-8c70cdcbe9ca tempest-TestStampPattern-1595853218 None] Created reservations ['cd17bf0d-78e9-459d-b333-5f5083b21238', 'f4e905ef-7e1e-4c54-819e-775bfe8cbc71', '77bde568-ec33-4da1-9d0a-658853cff6c1', 'ea5ffc1d-a194-45be-95c3-e95ef5c35bf4'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:52:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-71fb9508-322f-43b9-9194-8c70cdcbe9ca tempest-TestStampPattern-1595853218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:52:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-71fb9508-322f-43b9-9194-8c70cdcbe9ca tempest-TestStampPattern-1595853218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:52:17 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-71fb9508-322f-43b9-9194-8c70cdcbe9ca tempest-TestStampPattern-1595853218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:52:17 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-71fb9508-322f-43b9-9194-8c70cdcbe9ca tempest-TestStampPattern-1595853218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:52:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-71fb9508-322f-43b9-9194-8c70cdcbe9ca tempest-TestStampPattern-1595853218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:52:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-71fb9508-322f-43b9-9194-8c70cdcbe9ca tempest-TestStampPattern-1595853218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:17 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:52:17 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:18 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-71fb9508-322f-43b9-9194-8c70cdcbe9ca tempest-TestStampPattern-1595853218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.251s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:18 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-71fb9508-322f-43b9-9194-8c70cdcbe9ca tempest-TestStampPattern-1595853218 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:52:18 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-71fb9508-322f-43b9-9194-8c70cdcbe9ca tempest-TestStampPattern-1595853218 None] Deleted volume successfully. Jul 17 19:52:18 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-71fb9508-322f-43b9-9194-8c70cdcbe9ca tempest-TestStampPattern-1595853218 None] Lock "cinder-98dbaed7-0773-4d32-b9c5-04b0eaaffd90-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:52:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-9e5c76e8-a1a0-4e4f-bf52-a7c74f574efe req-825f425b-1609-4b9c-9de8-10f44c07914e tempest-TestShelveInstance-1061568434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:52:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-9e5c76e8-a1a0-4e4f-bf52-a7c74f574efe req-825f425b-1609-4b9c-9de8-10f44c07914e tempest-TestShelveInstance-1061568434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:52:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-9e5c76e8-a1a0-4e4f-bf52-a7c74f574efe req-825f425b-1609-4b9c-9de8-10f44c07914e tempest-TestShelveInstance-1061568434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:52:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-9e5c76e8-a1a0-4e4f-bf52-a7c74f574efe req-825f425b-1609-4b9c-9de8-10f44c07914e tempest-TestShelveInstance-1061568434 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55', 'name': 'volume-bcb5d3b0-995e-4830-b099-f03042fc6c12', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b76c9189-76d8-4e9b-93aa-874d0cf16e43', 'enforce_multipath': True} {{(pid=87726) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 19:52:19 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-9e5c76e8-a1a0-4e4f-bf52-a7c74f574efe req-825f425b-1609-4b9c-9de8-10f44c07914e tempest-TestShelveInstance-1061568434 None] attachment_update completed successfully. Jul 17 19:52:29 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=37,cinder:UPDATE=34,cinder:INSERT=14,cinder:DELETE=3 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:52:29 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=42,cinder:UPDATE=25,cinder:INSERT=12 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:52:34 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:52:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Flow 'volume_create_manager' (88947e47-1ffd-4f12-bd02-47e196a86d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:52:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceca6682-cdec-4ebf-97f7-757c6abef50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:52:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceca6682-cdec-4ebf-97f7-757c6abef50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68bbd945-addf-4cbc-823c-542d6a8c890d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a395fd2108f648cdb10d0c96543dd73a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:52:34Z,use_quota=True,user_id='422f037e65a54828b82570b911e8ef03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b778fe-45da-474a-84a0-6573da9c07b9),volume_type_id=69b778fe-45da-474a-84a0-6573da9c07b9)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:52:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e6f7f0e-b500-4e3e-b454-bedcf47f3619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:52:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e6f7f0e-b500-4e3e-b454-bedcf47f3619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:52:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631f4973-9129-4a73-89d3-a0be3befb425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:52:34 devstack cinder-volume[87726]: DEBUG cinder.image.glance [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Creating Keystone auth plugin from conf {{(pid=87726) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 19:52:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631f4973-9129-4a73-89d3-a0be3befb425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '68bbd945-addf-4cbc-823c-542d6a8c890d', 'volume_name': 'volume-68bbd945-addf-4cbc-823c-542d6a8c890d', 'volume_size': 1, 'image_id': '200fbe58-a234-4778-a578-ece5a35020f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/200fbe58-a234-4778-a578-ece5a35020f2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fdddde49947006c2a836588b6feb4265', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a395fd2108f648cdb10d0c96543dd73a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '39a83f4e14f36d196820ba3ba1d7d502cbe0ae502d0a355a518dd745290fe902c9bd31abe4b19b5c507f66b045f55101c6cea0f6b9ce5026920688dd16849345', 'id': '200fbe58-a234-4778-a578-ece5a35020f2', 'created_at': datetime.datetime(2026, 7, 17, 17, 52, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 17, 52, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/200fbe58-a234-4778-a578-ece5a35020f2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:52:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8b714c-63cc-4c41-b4ab-f265a534d97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:52:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8b714c-63cc-4c41-b4ab-f265a534d97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:52:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0adb840-cb2f-475d-87fb-42020a11049f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:52:34 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Volume 68bbd945-addf-4cbc-823c-542d6a8c890d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-68bbd945-addf-4cbc-823c-542d6a8c890d', 'volume_size': 1, 'image_id': '200fbe58-a234-4778-a578-ece5a35020f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/200fbe58-a234-4778-a578-ece5a35020f2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fdddde49947006c2a836588b6feb4265', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a395fd2108f648cdb10d0c96543dd73a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '39a83f4e14f36d196820ba3ba1d7d502cbe0ae502d0a355a518dd745290fe902c9bd31abe4b19b5c507f66b045f55101c6cea0f6b9ce5026920688dd16849345', 'id': '200fbe58-a234-4778-a578-ece5a35020f2', 'created_at': datetime.datetime(2026, 7, 17, 17, 52, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 17, 52, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/200fbe58-a234-4778-a578-ece5a35020f2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 17 19:52:34 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Trying to clone 68bbd945-addf-4cbc-823c-542d6a8c890d from image 200fbe58-a234-4778-a578-ece5a35020f2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/200fbe58-a234-4778-a578-ece5a35020f2', 'metadata': {}}]). {{(pid=87726) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 19:52:34 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_200fbe58-a234-4778-a578-ece5a35020f2_3_75we12devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87726) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 19:52:34 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Image download 0.00 MB at 0.00 MB/s Jul 17 19:52:34 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[154acd15-e363-4038-bc9d-9d7ad85aba71]: (4, 'raw') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:52:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_200fbe58-a234-4778-a578-ece5a35020f2_3_75we12devstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:34 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_200fbe58-a234-4778-a578-ece5a35020f2_3_75we12devstack@QuobyteHD Jul 17 19:52:34 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:34 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_200fbe58-a234-4778-a578-ece5a35020f2_3_75we12devstack@QuobyteHD" returned: 0 in 0.346s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_200fbe58-a234-4778-a578-ece5a35020f2_3_75we12devstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:34 devstack sudo[104054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_200fbe58-a234-4778-a578-ece5a35020f2_3_75we12devstack@QuobyteHD Jul 17 19:52:34 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:35 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_200fbe58-a234-4778-a578-ece5a35020f2_3_75we12devstack@QuobyteHD" returned: 1 in 0.323s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_200fbe58-a234-4778-a578-ece5a35020f2_3_75we12devstack@QuobyteHD' failed. Not Retrying. {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 19:52:35 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Temporary image 200fbe58-a234-4778-a578-ece5a35020f2 is fetched for user 422f037e65a54828b82570b911e8ef03. {{(pid=87726) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 19:52:35 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce14ba31-c041-4a4c-a3f6-505ec88ae1fb]: (4, 'raw') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:52:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_200fbe58-a234-4778-a578-ece5a35020f2_3_75we12devstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:35 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_200fbe58-a234-4778-a578-ece5a35020f2_3_75we12devstack@QuobyteHD Jul 17 19:52:35 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:35 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_200fbe58-a234-4778-a578-ece5a35020f2_3_75we12devstack@QuobyteHD" returned: 0 in 0.331s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_200fbe58-a234-4778-a578-ece5a35020f2_3_75we12devstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:35 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_200fbe58-a234-4778-a578-ece5a35020f2_3_75we12devstack@QuobyteHD Jul 17 19:52:35 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:35 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_200fbe58-a234-4778-a578-ece5a35020f2_3_75we12devstack@QuobyteHD" returned: 1 in 0.321s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_200fbe58-a234-4778-a578-ece5a35020f2_3_75we12devstack@QuobyteHD' failed. Not Retrying. {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 19:52:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:52:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:52:35 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68bbd945-addf-4cbc-823c-542d6a8c890d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a395fd2108f648cdb10d0c96543dd73a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:52:34Z,use_quota=True,user_id='422f037e65a54828b82570b911e8ef03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b778fe-45da-474a-84a0-6573da9c07b9),volume_type_id=69b778fe-45da-474a-84a0-6573da9c07b9)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:52:35 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Creating volume 68bbd945-addf-4cbc-823c-542d6a8c890d {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:52:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:52:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:52:35 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:52:35 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:52:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:52:35 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:52:35 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:52:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-68bbd945-addf-4cbc-823c-542d6a8c890d 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:35 devstack sudo[104068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-68bbd945-addf-4cbc-823c-542d6a8c890d 1073741824 Jul 17 19:52:35 devstack sudo[104068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:36 devstack sudo[104068]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-68bbd945-addf-4cbc-823c-542d6a8c890d 1073741824" returned: 0 in 0.440s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-68bbd945-addf-4cbc-823c-542d6a8c890d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:36 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-68bbd945-addf-4cbc-823c-542d6a8c890d Jul 17 19:52:36 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:36 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-68bbd945-addf-4cbc-823c-542d6a8c890d" returned: 0 in 0.250s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:52:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:52:36 devstack cinder-volume[87726]: DEBUG cinder.volume.volume_utils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Attempting download of 200fbe58-a234-4778-a578-ece5a35020f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/200fbe58-a234-4778-a578-ece5a35020f2', 'metadata': {}}])) to volume 68bbd945-addf-4cbc-823c-542d6a8c890d. {{(pid=87726) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 19:52:36 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb327bbc-67a4-4e7a-84b2-18f2cab1e372]: (4, 'raw') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:52:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_200fbe58-a234-4778-a578-ece5a35020f2_828dukyv {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:36 devstack sudo[104077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_200fbe58-a234-4778-a578-ece5a35020f2_828dukyv Jul 17 19:52:36 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:36 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_200fbe58-a234-4778-a578-ece5a35020f2_828dukyv" returned: 0 in 0.328s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_200fbe58-a234-4778-a578-ece5a35020f2_828dukyv {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:37 devstack sudo[104081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_200fbe58-a234-4778-a578-ece5a35020f2_828dukyv Jul 17 19:52:37 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:37 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_200fbe58-a234-4778-a578-ece5a35020f2_828dukyv" returned: 1 in 0.327s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_200fbe58-a234-4778-a578-ece5a35020f2_828dukyv' failed. Not Retrying. {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 19:52:37 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9409f1-b229-4a0f-9daf-a39bcc451aee]: (4, 'raw') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:52:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_200fbe58-a234-4778-a578-ece5a35020f2_3_75we12devstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:37 devstack sudo[104085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_200fbe58-a234-4778-a578-ece5a35020f2_3_75we12devstack@QuobyteHD Jul 17 19:52:37 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:37 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_200fbe58-a234-4778-a578-ece5a35020f2_3_75we12devstack@QuobyteHD" returned: 0 in 0.333s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_200fbe58-a234-4778-a578-ece5a35020f2_3_75we12devstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:37 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_200fbe58-a234-4778-a578-ece5a35020f2_3_75we12devstack@QuobyteHD Jul 17 19:52:37 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:38 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_200fbe58-a234-4778-a578-ece5a35020f2_3_75we12devstack@QuobyteHD" returned: 1 in 0.349s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_200fbe58-a234-4778-a578-ece5a35020f2_3_75we12devstack@QuobyteHD' failed. Not Retrying. {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 19:52:38 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] 200fbe58-a234-4778-a578-ece5a35020f2 was raw, converting to qcow2 {{(pid=87726) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 19:52:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_200fbe58-a234-4778-a578-ece5a35020f2_3_75we12devstack@QuobyteHD /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-68bbd945-addf-4cbc-823c-542d6a8c890d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:38 devstack sudo[104096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_200fbe58-a234-4778-a578-ece5a35020f2_3_75we12devstack@QuobyteHD /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-68bbd945-addf-4cbc-823c-542d6a8c890d Jul 17 19:52:38 devstack sudo[104096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:38 devstack sudo[104096]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_200fbe58-a234-4778-a578-ece5a35020f2_3_75we12devstack@QuobyteHD /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-68bbd945-addf-4cbc-823c-542d6a8c890d" returned: 0 in 0.573s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:38 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_200fbe58-a234-4778-a578-ece5a35020f2_3_75we12devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-68bbd945-addf-4cbc-823c-542d6a8c890d {{(pid=87726) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 19:52:38 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Converted 0.00 MB image at 0.00 MB/s Jul 17 19:52:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-68bbd945-addf-4cbc-823c-542d6a8c890d 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:38 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-68bbd945-addf-4cbc-823c-542d6a8c890d 1G Jul 17 19:52:38 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:38 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-68bbd945-addf-4cbc-823c-542d6a8c890d 1G" returned: 0 in 0.346s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:38 devstack cinder-volume[87726]: DEBUG cinder.volume.volume_utils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Downloaded image 200fbe58-a234-4778-a578-ece5a35020f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/200fbe58-a234-4778-a578-ece5a35020f2', 'metadata': {}}])) to volume 68bbd945-addf-4cbc-823c-542d6a8c890d successfully. {{(pid=87726) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 19:52:38 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Temporary image 200fbe58-a234-4778-a578-ece5a35020f2 for user 422f037e65a54828b82570b911e8ef03 is deleted. {{(pid=87726) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 19:52:38 devstack cinder-volume[87726]: DEBUG cinder.volume.volume_utils [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Marking volume 68bbd945-addf-4cbc-823c-542d6a8c890d as bootable. {{(pid=87726) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 19:52:38 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Copying metadata from image 200fbe58-a234-4778-a578-ece5a35020f2 to 68bbd945-addf-4cbc-823c-542d6a8c890d. {{(pid=87726) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 19:52:38 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Creating volume glance metadata for volume 68bbd945-addf-4cbc-823c-542d6a8c890d backed by image 200fbe58-a234-4778-a578-ece5a35020f2 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '200fbe58-a234-4778-a578-ece5a35020f2', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'fdddde49947006c2a836588b6feb4265', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87726) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 19:52:39 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0adb840-cb2f-475d-87fb-42020a11049f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68bbd945-addf-4cbc-823c-542d6a8c890d', 'volume_size': 1, 'image_id': '200fbe58-a234-4778-a578-ece5a35020f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/200fbe58-a234-4778-a578-ece5a35020f2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fdddde49947006c2a836588b6feb4265', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a395fd2108f648cdb10d0c96543dd73a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '39a83f4e14f36d196820ba3ba1d7d502cbe0ae502d0a355a518dd745290fe902c9bd31abe4b19b5c507f66b045f55101c6cea0f6b9ce5026920688dd16849345', 'id': '200fbe58-a234-4778-a578-ece5a35020f2', 'created_at': datetime.datetime(2026, 7, 17, 17, 52, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 17, 52, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/200fbe58-a234-4778-a578-ece5a35020f2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:52:39 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c6f875-36d8-47d2-8e63-f6bbe3e6d812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:52:39 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Volume volume-68bbd945-addf-4cbc-823c-542d6a8c890d (68bbd945-addf-4cbc-823c-542d6a8c890d): created successfully Jul 17 19:52:39 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c6f875-36d8-47d2-8e63-f6bbe3e6d812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:52:39 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Flow 'volume_create_manager' (88947e47-1ffd-4f12-bd02-47e196a86d9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:52:39 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-b9630aca-abcc-47af-8adc-ec00a46d41a9 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Created volume successfully. Jul 17 19:52:39 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-69f7a19a-57c6-49f5-972e-d537f3f64852 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Acquiring lock "cinder-68bbd945-addf-4cbc-823c-542d6a8c890d-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:52:39 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-69f7a19a-57c6-49f5-972e-d537f3f64852 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Lock "cinder-68bbd945-addf-4cbc-823c-542d6a8c890d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:52:39 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-69f7a19a-57c6-49f5-972e-d537f3f64852 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Acquiring lock "cinder-quobyte-68bbd945-addf-4cbc-823c-542d6a8c890d" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:52:39 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-69f7a19a-57c6-49f5-972e-d537f3f64852 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Lock "cinder-quobyte-68bbd945-addf-4cbc-823c-542d6a8c890d" acquired by "delete_volume" :: waited 0.019s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:52:39 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8ca336-a839-400a-932f-2dd8e9868771]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:52:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-69f7a19a-57c6-49f5-972e-d537f3f64852 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-68bbd945-addf-4cbc-823c-542d6a8c890d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:39 devstack sudo[104116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-68bbd945-addf-4cbc-823c-542d6a8c890d Jul 17 19:52:39 devstack sudo[104116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:39 devstack sudo[104116]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-69f7a19a-57c6-49f5-972e-d537f3f64852 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-68bbd945-addf-4cbc-823c-542d6a8c890d" returned: 0 in 0.356s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-69f7a19a-57c6-49f5-972e-d537f3f64852 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-68bbd945-addf-4cbc-823c-542d6a8c890d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:39 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-68bbd945-addf-4cbc-823c-542d6a8c890d Jul 17 19:52:39 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:40 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-69f7a19a-57c6-49f5-972e-d537f3f64852 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-68bbd945-addf-4cbc-823c-542d6a8c890d" returned: 0 in 0.241s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:40 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-69f7a19a-57c6-49f5-972e-d537f3f64852 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Lock "cinder-quobyte-68bbd945-addf-4cbc-823c-542d6a8c890d" released by "delete_volume" :: held 0.647s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:52:40 devstack cinder-volume[87726]: WARNING cinder.quota [None req-69f7a19a-57c6-49f5-972e-d537f3f64852 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:52:40 devstack cinder-volume[87726]: WARNING cinder.quota [None req-69f7a19a-57c6-49f5-972e-d537f3f64852 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 17 19:52:40 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-69f7a19a-57c6-49f5-972e-d537f3f64852 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Created reservations ['3e7ad712-9df1-43fc-ab10-8e86905ad908', 'a71b747b-5ec3-4545-bdb1-263e62f44c57', 'c9af81a4-dc2e-4e89-8f0c-16be465c8df8', 'a87c66de-93cd-4cda-b531-a4c0f5bcc1ae'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:52:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-69f7a19a-57c6-49f5-972e-d537f3f64852 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:52:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-69f7a19a-57c6-49f5-972e-d537f3f64852 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:52:40 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-69f7a19a-57c6-49f5-972e-d537f3f64852 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:52:40 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-69f7a19a-57c6-49f5-972e-d537f3f64852 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:52:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-69f7a19a-57c6-49f5-972e-d537f3f64852 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:52:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-69f7a19a-57c6-49f5-972e-d537f3f64852 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:40 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:52:40 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:40 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-69f7a19a-57c6-49f5-972e-d537f3f64852 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.232s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:40 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-69f7a19a-57c6-49f5-972e-d537f3f64852 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:52:40 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-69f7a19a-57c6-49f5-972e-d537f3f64852 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Deleted volume successfully. Jul 17 19:52:40 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-69f7a19a-57c6-49f5-972e-d537f3f64852 tempest-VolumeAndVolumeTypeFromImageTest-1081386408 None] Lock "cinder-68bbd945-addf-4cbc-823c-542d6a8c890d-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:52:45 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:52:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] Flow 'volume_create_manager' (9b4b8510-5c8e-4c99-b467-99b58086a8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:52:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38193928-507c-454c-ab96-12c8360f237f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:52:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38193928-507c-454c-ab96-12c8360f237f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-570913259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82d60ae6-4f88-41d2-a1ae-c371ebcf4755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0396b90501e4d11bf6d7e769a233d90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:52:45Z,use_quota=True,user_id='6c26ba973cb94d0dad22e8212fea2e37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:52:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0b38bc6-6918-4741-b851-b6acefb90c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:52:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0b38bc6-6918-4741-b851-b6acefb90c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:52:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e00a44d-75a7-4c0c-a6d4-d674ca9469c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:52:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e00a44d-75a7-4c0c-a6d4-d674ca9469c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82d60ae6-4f88-41d2-a1ae-c371ebcf4755', 'volume_name': 'volume-82d60ae6-4f88-41d2-a1ae-c371ebcf4755', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:52:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (482a74e6-d32b-4f1b-b6f8-a1de9c15249a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:52:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (482a74e6-d32b-4f1b-b6f8-a1de9c15249a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:52:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (841817e9-a645-408f-8661-c9825a7e78b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:52:45 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] Volume 82d60ae6-4f88-41d2-a1ae-c371ebcf4755: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82d60ae6-4f88-41d2-a1ae-c371ebcf4755', 'volume_size': 1} Jul 17 19:52:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:52:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:52:45 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-570913259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82d60ae6-4f88-41d2-a1ae-c371ebcf4755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0396b90501e4d11bf6d7e769a233d90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:52:45Z,use_quota=True,user_id='6c26ba973cb94d0dad22e8212fea2e37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:52:45 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] Creating volume 82d60ae6-4f88-41d2-a1ae-c371ebcf4755 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:52:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:52:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:52:45 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:52:45 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:52:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:52:45 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:52:45 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:52:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82d60ae6-4f88-41d2-a1ae-c371ebcf4755 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:45 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82d60ae6-4f88-41d2-a1ae-c371ebcf4755 1073741824 Jul 17 19:52:45 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:45 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82d60ae6-4f88-41d2-a1ae-c371ebcf4755 1073741824" returned: 0 in 0.393s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82d60ae6-4f88-41d2-a1ae-c371ebcf4755 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:45 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82d60ae6-4f88-41d2-a1ae-c371ebcf4755 Jul 17 19:52:45 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:46 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82d60ae6-4f88-41d2-a1ae-c371ebcf4755" returned: 0 in 0.245s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:46 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:52:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:52:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (841817e9-a645-408f-8661-c9825a7e78b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82d60ae6-4f88-41d2-a1ae-c371ebcf4755', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:52:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3794b4d6-9622-46b3-afdc-323ff673fe61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:52:46 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] Volume volume-82d60ae6-4f88-41d2-a1ae-c371ebcf4755 (82d60ae6-4f88-41d2-a1ae-c371ebcf4755): created successfully Jul 17 19:52:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3794b4d6-9622-46b3-afdc-323ff673fe61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:52:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] Flow 'volume_create_manager' (9b4b8510-5c8e-4c99-b467-99b58086a8c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:52:46 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-18561f93-9b0f-4170-b30f-0c97d0e12e9e tempest-ProjectReaderTests-1452320451 None] Created volume successfully. Jul 17 19:52:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-571b196f-198b-468d-964a-ba94b7061de7 tempest-ProjectReaderTests-1452320451 None] Acquiring lock "cinder-82d60ae6-4f88-41d2-a1ae-c371ebcf4755-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:52:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-571b196f-198b-468d-964a-ba94b7061de7 tempest-ProjectReaderTests-1452320451 None] Lock "cinder-82d60ae6-4f88-41d2-a1ae-c371ebcf4755-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:52:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-571b196f-198b-468d-964a-ba94b7061de7 tempest-ProjectReaderTests-1452320451 None] Acquiring lock "cinder-quobyte-82d60ae6-4f88-41d2-a1ae-c371ebcf4755" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:52:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-571b196f-198b-468d-964a-ba94b7061de7 tempest-ProjectReaderTests-1452320451 None] Lock "cinder-quobyte-82d60ae6-4f88-41d2-a1ae-c371ebcf4755" acquired by "delete_volume" :: waited 0.014s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:52:46 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[e667d588-7b30-4b22-ba20-a480444ed1a6]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:52:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-571b196f-198b-468d-964a-ba94b7061de7 tempest-ProjectReaderTests-1452320451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82d60ae6-4f88-41d2-a1ae-c371ebcf4755 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:46 devstack sudo[104161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82d60ae6-4f88-41d2-a1ae-c371ebcf4755 Jul 17 19:52:46 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:47 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-571b196f-198b-468d-964a-ba94b7061de7 tempest-ProjectReaderTests-1452320451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82d60ae6-4f88-41d2-a1ae-c371ebcf4755" returned: 0 in 0.359s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-571b196f-198b-468d-964a-ba94b7061de7 tempest-ProjectReaderTests-1452320451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82d60ae6-4f88-41d2-a1ae-c371ebcf4755 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:47 devstack sudo[104166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82d60ae6-4f88-41d2-a1ae-c371ebcf4755 Jul 17 19:52:47 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:47 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-571b196f-198b-468d-964a-ba94b7061de7 tempest-ProjectReaderTests-1452320451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-82d60ae6-4f88-41d2-a1ae-c371ebcf4755" returned: 0 in 0.238s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-571b196f-198b-468d-964a-ba94b7061de7 tempest-ProjectReaderTests-1452320451 None] Lock "cinder-quobyte-82d60ae6-4f88-41d2-a1ae-c371ebcf4755" released by "delete_volume" :: held 0.639s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:52:47 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-571b196f-198b-468d-964a-ba94b7061de7 tempest-ProjectReaderTests-1452320451 None] Created reservations ['d3d6cd80-ebb0-44a8-bab8-7242a701eb61', 'fcbf358e-ea75-4134-a63c-5da072a82292', '6be14ad3-7ce0-4429-aa7f-fc2aecfdd0e0', '7d9a723d-0874-43ef-9643-a09e9e2ab690'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:52:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-571b196f-198b-468d-964a-ba94b7061de7 tempest-ProjectReaderTests-1452320451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:52:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-571b196f-198b-468d-964a-ba94b7061de7 tempest-ProjectReaderTests-1452320451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:52:47 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-571b196f-198b-468d-964a-ba94b7061de7 tempest-ProjectReaderTests-1452320451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:52:47 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-571b196f-198b-468d-964a-ba94b7061de7 tempest-ProjectReaderTests-1452320451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:52:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-571b196f-198b-468d-964a-ba94b7061de7 tempest-ProjectReaderTests-1452320451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:52:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-571b196f-198b-468d-964a-ba94b7061de7 tempest-ProjectReaderTests-1452320451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:47 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:52:47 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:47 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-571b196f-198b-468d-964a-ba94b7061de7 tempest-ProjectReaderTests-1452320451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.242s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:47 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-571b196f-198b-468d-964a-ba94b7061de7 tempest-ProjectReaderTests-1452320451 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:52:47 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-571b196f-198b-468d-964a-ba94b7061de7 tempest-ProjectReaderTests-1452320451 None] Deleted volume successfully. Jul 17 19:52:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-571b196f-198b-468d-964a-ba94b7061de7 tempest-ProjectReaderTests-1452320451 None] Lock "cinder-82d60ae6-4f88-41d2-a1ae-c371ebcf4755-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:52:48 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:52:48 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] Flow 'volume_create_manager' (1893c0b1-9ffe-4d0a-a4be-4b9b017071cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:52:48 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd1a45ae-c504-425f-8a06-8f520e48c725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:52:48 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd1a45ae-c504-425f-8a06-8f520e48c725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-386321516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b2350b5-bee8-49ae-bb94-25af0f663d08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0396b90501e4d11bf6d7e769a233d90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:52:48Z,use_quota=True,user_id='6c26ba973cb94d0dad22e8212fea2e37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:52:48 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3dc130-38ec-400c-b8cf-b721f3b81ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:52:48 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3dc130-38ec-400c-b8cf-b721f3b81ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:52:48 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ae57e7d-521e-48bf-9195-e0767a4cc84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:52:48 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ae57e7d-521e-48bf-9195-e0767a4cc84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b2350b5-bee8-49ae-bb94-25af0f663d08', 'volume_name': 'volume-5b2350b5-bee8-49ae-bb94-25af0f663d08', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:52:48 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7664e425-7d64-4f3b-84de-82ff0b56391c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:52:48 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7664e425-7d64-4f3b-84de-82ff0b56391c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:52:48 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (404dadbb-e499-4e6a-bc1d-982d5906ee16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:52:48 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] Volume 5b2350b5-bee8-49ae-bb94-25af0f663d08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b2350b5-bee8-49ae-bb94-25af0f663d08', 'volume_size': 1} Jul 17 19:52:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:52:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:52:48 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-386321516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b2350b5-bee8-49ae-bb94-25af0f663d08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0396b90501e4d11bf6d7e769a233d90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:52:48Z,use_quota=True,user_id='6c26ba973cb94d0dad22e8212fea2e37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:52:48 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] Creating volume 5b2350b5-bee8-49ae-bb94-25af0f663d08 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:52:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:52:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:52:48 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:52:48 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:52:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:52:48 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:52:48 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:52:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5b2350b5-bee8-49ae-bb94-25af0f663d08 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:48 devstack sudo[104172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5b2350b5-bee8-49ae-bb94-25af0f663d08 1073741824 Jul 17 19:52:48 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:48 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5b2350b5-bee8-49ae-bb94-25af0f663d08 1073741824" returned: 0 in 0.427s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5b2350b5-bee8-49ae-bb94-25af0f663d08 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:48 devstack sudo[104177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5b2350b5-bee8-49ae-bb94-25af0f663d08 Jul 17 19:52:48 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:49 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5b2350b5-bee8-49ae-bb94-25af0f663d08" returned: 0 in 0.262s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:49 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:52:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:52:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (404dadbb-e499-4e6a-bc1d-982d5906ee16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b2350b5-bee8-49ae-bb94-25af0f663d08', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:52:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (892c4160-a09e-491a-8a9b-5517bd2b5afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:52:49 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] Volume volume-5b2350b5-bee8-49ae-bb94-25af0f663d08 (5b2350b5-bee8-49ae-bb94-25af0f663d08): created successfully Jul 17 19:52:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (892c4160-a09e-491a-8a9b-5517bd2b5afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:52:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] Flow 'volume_create_manager' (1893c0b1-9ffe-4d0a-a4be-4b9b017071cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:52:49 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-5ffef23c-f0da-4402-a8f8-f2b25f83b40e tempest-ProjectReaderTests-1452320451 None] Created volume successfully. Jul 17 19:52:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a82ed7df-1caa-41c5-b75a-a1d063d836dc tempest-ProjectReaderTests-1452320451 None] Acquiring lock "cinder-5b2350b5-bee8-49ae-bb94-25af0f663d08-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:52:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a82ed7df-1caa-41c5-b75a-a1d063d836dc tempest-ProjectReaderTests-1452320451 None] Lock "cinder-5b2350b5-bee8-49ae-bb94-25af0f663d08-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:52:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a82ed7df-1caa-41c5-b75a-a1d063d836dc tempest-ProjectReaderTests-1452320451 None] Acquiring lock "cinder-quobyte-5b2350b5-bee8-49ae-bb94-25af0f663d08" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:52:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a82ed7df-1caa-41c5-b75a-a1d063d836dc tempest-ProjectReaderTests-1452320451 None] Lock "cinder-quobyte-5b2350b5-bee8-49ae-bb94-25af0f663d08" acquired by "delete_volume" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:52:49 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[24462641-b473-49c2-b7a5-b23e98ec90c6]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:52:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a82ed7df-1caa-41c5-b75a-a1d063d836dc tempest-ProjectReaderTests-1452320451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5b2350b5-bee8-49ae-bb94-25af0f663d08 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:49 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5b2350b5-bee8-49ae-bb94-25af0f663d08 Jul 17 19:52:49 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:49 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a82ed7df-1caa-41c5-b75a-a1d063d836dc tempest-ProjectReaderTests-1452320451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5b2350b5-bee8-49ae-bb94-25af0f663d08" returned: 0 in 0.385s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a82ed7df-1caa-41c5-b75a-a1d063d836dc tempest-ProjectReaderTests-1452320451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5b2350b5-bee8-49ae-bb94-25af0f663d08 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:49 devstack sudo[104195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5b2350b5-bee8-49ae-bb94-25af0f663d08 Jul 17 19:52:49 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:49 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a82ed7df-1caa-41c5-b75a-a1d063d836dc tempest-ProjectReaderTests-1452320451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5b2350b5-bee8-49ae-bb94-25af0f663d08" returned: 0 in 0.253s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a82ed7df-1caa-41c5-b75a-a1d063d836dc tempest-ProjectReaderTests-1452320451 None] Lock "cinder-quobyte-5b2350b5-bee8-49ae-bb94-25af0f663d08" released by "delete_volume" :: held 0.678s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:52:50 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-a82ed7df-1caa-41c5-b75a-a1d063d836dc tempest-ProjectReaderTests-1452320451 None] Created reservations ['f76c54c0-ac6e-42ac-9598-99f0f04270d3', 'f3779438-5880-4a0b-99dd-2f6496d24f29', 'd9d63ca8-ac0b-410f-9504-a674bff796f8', '984335b4-094b-40c2-92b7-d58feff905ba'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:52:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a82ed7df-1caa-41c5-b75a-a1d063d836dc tempest-ProjectReaderTests-1452320451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:52:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a82ed7df-1caa-41c5-b75a-a1d063d836dc tempest-ProjectReaderTests-1452320451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:52:50 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a82ed7df-1caa-41c5-b75a-a1d063d836dc tempest-ProjectReaderTests-1452320451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:52:50 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a82ed7df-1caa-41c5-b75a-a1d063d836dc tempest-ProjectReaderTests-1452320451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:52:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a82ed7df-1caa-41c5-b75a-a1d063d836dc tempest-ProjectReaderTests-1452320451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:52:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a82ed7df-1caa-41c5-b75a-a1d063d836dc tempest-ProjectReaderTests-1452320451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:52:50 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:52:50 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:52:50 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Jul 17 19:52:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a82ed7df-1caa-41c5-b75a-a1d063d836dc tempest-ProjectReaderTests-1452320451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.278s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:52:50 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-a82ed7df-1caa-41c5-b75a-a1d063d836dc tempest-ProjectReaderTests-1452320451 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:52:50 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-a82ed7df-1caa-41c5-b75a-a1d063d836dc tempest-ProjectReaderTests-1452320451 None] Deleted volume successfully. Jul 17 19:52:50 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a82ed7df-1caa-41c5-b75a-a1d063d836dc tempest-ProjectReaderTests-1452320451 None] Lock "cinder-5b2350b5-bee8-49ae-bb94-25af0f663d08-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:52:53 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-c2a9dcd0-5ef8-48d0-b431-59e8b5f5b947 req-633fd1cb-b667-4c2c-85f9-dbe879e3be0e tempest-TestShelveInstance-1061568434 None] Terminate volume connection completed successfully. Jul 17 19:52:53 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-c2a9dcd0-5ef8-48d0-b431-59e8b5f5b947 req-633fd1cb-b667-4c2c-85f9-dbe879e3be0e tempest-TestShelveInstance-1061568434 None] Deleting attachment b76c9189-76d8-4e9b-93aa-874d0cf16e43. {{(pid=87726) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 19:52:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-3296628d-9726-41f6-bfbc-22eee49acce2 req-c23641ac-fedf-4998-8d9f-b76029966897 tempest-TestShelveInstance-1061568434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:52:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-3296628d-9726-41f6-bfbc-22eee49acce2 req-c23641ac-fedf-4998-8d9f-b76029966897 tempest-TestShelveInstance-1061568434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:52:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-3296628d-9726-41f6-bfbc-22eee49acce2 req-c23641ac-fedf-4998-8d9f-b76029966897 tempest-TestShelveInstance-1061568434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:52:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-3296628d-9726-41f6-bfbc-22eee49acce2 req-c23641ac-fedf-4998-8d9f-b76029966897 tempest-TestShelveInstance-1061568434 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55', 'name': 'volume-bcb5d3b0-995e-4830-b099-f03042fc6c12', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '35f0bc6b-37b6-4e03-84f4-24abea8face1', 'enforce_multipath': True} {{(pid=87726) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 19:52:56 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-3296628d-9726-41f6-bfbc-22eee49acce2 req-c23641ac-fedf-4998-8d9f-b76029966897 tempest-TestShelveInstance-1061568434 None] attachment_update completed successfully. Jul 17 19:53:06 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=32,cinder:UPDATE=39,cinder:INSERT=14,cinder:DELETE=3 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:53:06 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=37,cinder:INSERT=11,cinder:UPDATE=33,cinder:DELETE=3 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:53:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:53:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:53:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:53:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:53:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:53:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:53:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:15 devstack sudo[104750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:53:15 devstack sudo[104750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:15 devstack sudo[104750]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.254s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:15 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:53:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager._thread_info {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:53:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread count: 28 {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 19:53:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread info: [<_MainThread(MainThread, started 130066227544192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 19:53:23 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-501ee979-6a44-4243-b750-4e7adbdd9cdc req-249ac1b3-053a-4fa5-8407-65efeeaefad2 tempest-TestShelveInstance-1061568434 None] Terminate volume connection completed successfully. Jul 17 19:53:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [req-501ee979-6a44-4243-b750-4e7adbdd9cdc req-249ac1b3-053a-4fa5-8407-65efeeaefad2 tempest-TestShelveInstance-1061568434 None] Deleting attachment 35f0bc6b-37b6-4e03-84f4-24abea8face1. {{(pid=87726) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 19:53:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [req-501ee979-6a44-4243-b750-4e7adbdd9cdc req-6d48c315-d225-4042-ad4d-cc283873a785 tempest-TestShelveInstance-1061568434 None] Acquiring lock "cinder-bcb5d3b0-995e-4830-b099-f03042fc6c12-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:53:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [req-501ee979-6a44-4243-b750-4e7adbdd9cdc req-6d48c315-d225-4042-ad4d-cc283873a785 tempest-TestShelveInstance-1061568434 None] Lock "cinder-bcb5d3b0-995e-4830-b099-f03042fc6c12-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:53:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [req-501ee979-6a44-4243-b750-4e7adbdd9cdc req-6d48c315-d225-4042-ad4d-cc283873a785 tempest-TestShelveInstance-1061568434 None] Acquiring lock "cinder-quobyte-bcb5d3b0-995e-4830-b099-f03042fc6c12" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:53:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [req-501ee979-6a44-4243-b750-4e7adbdd9cdc req-6d48c315-d225-4042-ad4d-cc283873a785 tempest-TestShelveInstance-1061568434 None] Lock "cinder-quobyte-bcb5d3b0-995e-4830-b099-f03042fc6c12" acquired by "delete_volume" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:53:23 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c18b3b-1c3d-4c0e-86ae-36365ae89590]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:53:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-501ee979-6a44-4243-b750-4e7adbdd9cdc req-6d48c315-d225-4042-ad4d-cc283873a785 tempest-TestShelveInstance-1061568434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bcb5d3b0-995e-4830-b099-f03042fc6c12 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:23 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bcb5d3b0-995e-4830-b099-f03042fc6c12 Jul 17 19:53:23 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:23 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-501ee979-6a44-4243-b750-4e7adbdd9cdc req-6d48c315-d225-4042-ad4d-cc283873a785 tempest-TestShelveInstance-1061568434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bcb5d3b0-995e-4830-b099-f03042fc6c12" returned: 0 in 0.386s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-501ee979-6a44-4243-b750-4e7adbdd9cdc req-6d48c315-d225-4042-ad4d-cc283873a785 tempest-TestShelveInstance-1061568434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bcb5d3b0-995e-4830-b099-f03042fc6c12 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:23 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bcb5d3b0-995e-4830-b099-f03042fc6c12 Jul 17 19:53:23 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:24 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-501ee979-6a44-4243-b750-4e7adbdd9cdc req-6d48c315-d225-4042-ad4d-cc283873a785 tempest-TestShelveInstance-1061568434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-bcb5d3b0-995e-4830-b099-f03042fc6c12" returned: 0 in 0.232s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:24 devstack cinder-volume[87726]: DEBUG cinder.coordination [req-501ee979-6a44-4243-b750-4e7adbdd9cdc req-6d48c315-d225-4042-ad4d-cc283873a785 tempest-TestShelveInstance-1061568434 None] Lock "cinder-quobyte-bcb5d3b0-995e-4830-b099-f03042fc6c12" released by "delete_volume" :: held 0.661s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:53:24 devstack cinder-volume[87726]: DEBUG cinder.quota [req-501ee979-6a44-4243-b750-4e7adbdd9cdc req-6d48c315-d225-4042-ad4d-cc283873a785 tempest-TestShelveInstance-1061568434 None] Created reservations ['d7cf1cc6-7557-4712-acdd-cc477b0cf491', 'a779547f-eb4a-44ab-b282-a66861fd8559', '0eebbab2-d7db-4984-a9ae-efb0ddf89316', 'b6a49158-4465-4832-9e69-ad7d09a4ca77'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:53:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-501ee979-6a44-4243-b750-4e7adbdd9cdc req-6d48c315-d225-4042-ad4d-cc283873a785 tempest-TestShelveInstance-1061568434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:53:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-501ee979-6a44-4243-b750-4e7adbdd9cdc req-6d48c315-d225-4042-ad4d-cc283873a785 tempest-TestShelveInstance-1061568434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:53:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [req-501ee979-6a44-4243-b750-4e7adbdd9cdc req-6d48c315-d225-4042-ad4d-cc283873a785 tempest-TestShelveInstance-1061568434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:53:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [req-501ee979-6a44-4243-b750-4e7adbdd9cdc req-6d48c315-d225-4042-ad4d-cc283873a785 tempest-TestShelveInstance-1061568434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:53:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [req-501ee979-6a44-4243-b750-4e7adbdd9cdc req-6d48c315-d225-4042-ad4d-cc283873a785 tempest-TestShelveInstance-1061568434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:53:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-501ee979-6a44-4243-b750-4e7adbdd9cdc req-6d48c315-d225-4042-ad4d-cc283873a785 tempest-TestShelveInstance-1061568434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:24 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:53:24 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:24 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [req-501ee979-6a44-4243-b750-4e7adbdd9cdc req-6d48c315-d225-4042-ad4d-cc283873a785 tempest-TestShelveInstance-1061568434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.251s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:24 devstack cinder-volume[87726]: DEBUG cinder.manager [req-501ee979-6a44-4243-b750-4e7adbdd9cdc req-6d48c315-d225-4042-ad4d-cc283873a785 tempest-TestShelveInstance-1061568434 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:53:24 devstack cinder-volume[87726]: INFO cinder.volume.manager [req-501ee979-6a44-4243-b750-4e7adbdd9cdc req-6d48c315-d225-4042-ad4d-cc283873a785 tempest-TestShelveInstance-1061568434 None] Deleted volume successfully. Jul 17 19:53:24 devstack cinder-volume[87726]: DEBUG cinder.coordination [req-501ee979-6a44-4243-b750-4e7adbdd9cdc req-6d48c315-d225-4042-ad4d-cc283873a785 tempest-TestShelveInstance-1061568434 None] Lock "cinder-bcb5d3b0-995e-4830-b099-f03042fc6c12-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] Flow 'volume_create_manager' (5e46a9de-c1f7-4c05-a529-e0ed91e96795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efd49f1f-89f4-493e-a5ac-c8a6d101c4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efd49f1f-89f4-493e-a5ac-c8a6d101c4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1518387639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ee048a-5144-4090-816a-8f71ada769c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b233cc5c0fc46ada6c5b1006f144f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:53:34Z,use_quota=True,user_id='9a28190b878f4f8a9a5f7c70efc014e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b250c9-1548-4027-acd3-6998cfccba75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b250c9-1548-4027-acd3-6998cfccba75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0afc57e-2d71-49e0-873c-51b89e61c6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0afc57e-2d71-49e0-873c-51b89e61c6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69ee048a-5144-4090-816a-8f71ada769c2', 'volume_name': 'volume-69ee048a-5144-4090-816a-8f71ada769c2', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a059426e-8eef-4991-9f3f-84f4b207717e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a059426e-8eef-4991-9f3f-84f4b207717e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ee30b5-f225-4996-99a8-5eb6eca31762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:53:34 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] Volume 69ee048a-5144-4090-816a-8f71ada769c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69ee048a-5144-4090-816a-8f71ada769c2', 'volume_size': 1} Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1518387639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ee048a-5144-4090-816a-8f71ada769c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b233cc5c0fc46ada6c5b1006f144f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:53:34Z,use_quota=True,user_id='9a28190b878f4f8a9a5f7c70efc014e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] Creating volume 69ee048a-5144-4090-816a-8f71ada769c2 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:53:34 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:34 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2 1073741824 Jul 17 19:53:34 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:34 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2 1073741824" returned: 0 in 0.408s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:34 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2 Jul 17 19:53:34 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:34 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2" returned: 0 in 0.236s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ee30b5-f225-4996-99a8-5eb6eca31762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69ee048a-5144-4090-816a-8f71ada769c2', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d494f3d-8996-4f6d-b4ab-7057e2b305fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:53:34 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] Volume volume-69ee048a-5144-4090-816a-8f71ada769c2 (69ee048a-5144-4090-816a-8f71ada769c2): created successfully Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d494f3d-8996-4f6d-b4ab-7057e2b305fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:53:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] Flow 'volume_create_manager' (5e46a9de-c1f7-4c05-a529-e0ed91e96795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:53:34 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-6913c7b0-6c34-430e-b300-6f636cad9eae tempest-VolumeDependencyTests-1861584587 None] Created volume successfully. Jul 17 19:53:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-45fc2e93-d798-4af0-b7db-d731c086409d tempest-VolumeDependencyTests-1861584587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:53:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-45fc2e93-d798-4af0-b7db-d731c086409d tempest-VolumeDependencyTests-1861584587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:53:35 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-45fc2e93-d798-4af0-b7db-d731c086409d tempest-VolumeDependencyTests-1861584587 None] Creating offline snapshot fca80e7e-4611-4eb8-88e7-a98ffbcc06a4 of volume 69ee048a-5144-4090-816a-8f71ada769c2 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:53:35 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8d1c6f-ee15-4408-b95e-b7e590d5e666]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:53:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-45fc2e93-d798-4af0-b7db-d731c086409d tempest-VolumeDependencyTests-1861584587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:35 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2 Jul 17 19:53:35 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:35 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-45fc2e93-d798-4af0-b7db-d731c086409d tempest-VolumeDependencyTests-1861584587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2" returned: 0 in 0.351s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-45fc2e93-d798-4af0-b7db-d731c086409d tempest-VolumeDependencyTests-1861584587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2.fca80e7e-4611-4eb8-88e7-a98ffbcc06a4 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:35 devstack sudo[104840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2.fca80e7e-4611-4eb8-88e7-a98ffbcc06a4 1G Jul 17 19:53:35 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:36 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-45fc2e93-d798-4af0-b7db-d731c086409d tempest-VolumeDependencyTests-1861584587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2.fca80e7e-4611-4eb8-88e7-a98ffbcc06a4 1G" returned: 0 in 0.372s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-45fc2e93-d798-4af0-b7db-d731c086409d tempest-VolumeDependencyTests-1861584587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69ee048a-5144-4090-816a-8f71ada769c2 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2.fca80e7e-4611-4eb8-88e7-a98ffbcc06a4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:36 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69ee048a-5144-4090-816a-8f71ada769c2 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2.fca80e7e-4611-4eb8-88e7-a98ffbcc06a4 Jul 17 19:53:36 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:36 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-45fc2e93-d798-4af0-b7db-d731c086409d tempest-VolumeDependencyTests-1861584587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69ee048a-5144-4090-816a-8f71ada769c2 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2.fca80e7e-4611-4eb8-88e7-a98ffbcc06a4" returned: 0 in 0.273s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:36 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-45fc2e93-d798-4af0-b7db-d731c086409d tempest-VolumeDependencyTests-1861584587 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2.fca80e7e-4611-4eb8-88e7-a98ffbcc06a4 is being set with open permissions: ugo+rw Jul 17 19:53:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-45fc2e93-d798-4af0-b7db-d731c086409d tempest-VolumeDependencyTests-1861584587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2.fca80e7e-4611-4eb8-88e7-a98ffbcc06a4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:36 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2.fca80e7e-4611-4eb8-88e7-a98ffbcc06a4 Jul 17 19:53:36 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:36 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-45fc2e93-d798-4af0-b7db-d731c086409d tempest-VolumeDependencyTests-1861584587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2.fca80e7e-4611-4eb8-88e7-a98ffbcc06a4" returned: 0 in 0.245s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-45fc2e93-d798-4af0-b7db-d731c086409d tempest-VolumeDependencyTests-1861584587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:36 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2.info Jul 17 19:53:36 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:36 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-45fc2e93-d798-4af0-b7db-d731c086409d tempest-VolumeDependencyTests-1861584587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2.info" returned: 0 in 0.236s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:36 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-45fc2e93-d798-4af0-b7db-d731c086409d tempest-VolumeDependencyTests-1861584587 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2.info is being set with open permissions: ugo+rw Jul 17 19:53:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-45fc2e93-d798-4af0-b7db-d731c086409d tempest-VolumeDependencyTests-1861584587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:36 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2.info Jul 17 19:53:36 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:37 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-45fc2e93-d798-4af0-b7db-d731c086409d tempest-VolumeDependencyTests-1861584587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2.info" returned: 0 in 0.233s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-45fc2e93-d798-4af0-b7db-d731c086409d tempest-VolumeDependencyTests-1861584587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.787s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:53:37 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-45fc2e93-d798-4af0-b7db-d731c086409d tempest-VolumeDependencyTests-1861584587 None] Create snapshot completed successfully Jul 17 19:53:37 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:53:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Flow 'volume_create_manager' (12447cba-39d3-45f7-8078-ca42b594977b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:53:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5155aab4-5498-49ff-996a-dce5b85a3d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:53:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5155aab4-5498-49ff-996a-dce5b85a3d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-516137786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55b351c7-e15d-4110-a6f7-1f735e199ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b233cc5c0fc46ada6c5b1006f144f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fca80e7e-4611-4eb8-88e7-a98ffbcc06a4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:53:38Z,use_quota=True,user_id='9a28190b878f4f8a9a5f7c70efc014e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:53:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba486ff-012d-4f27-9580-5f834d5bff5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:53:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba486ff-012d-4f27-9580-5f834d5bff5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:53:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7094f27a-c1ff-440c-8f8f-a2a8653714ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:53:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7094f27a-c1ff-440c-8f8f-a2a8653714ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '55b351c7-e15d-4110-a6f7-1f735e199ed0', 'volume_name': 'volume-55b351c7-e15d-4110-a6f7-1f735e199ed0', 'volume_size': 1, 'snapshot_id': 'fca80e7e-4611-4eb8-88e7-a98ffbcc06a4'}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:53:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ebf87c-ea56-4a71-9763-1a623e12ff27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:53:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ebf87c-ea56-4a71-9763-1a623e12ff27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:53:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4004bddf-fbe3-4380-a594-1518afe42f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:53:37 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Volume 55b351c7-e15d-4110-a6f7-1f735e199ed0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-55b351c7-e15d-4110-a6f7-1f735e199ed0', 'volume_size': 1, 'snapshot_id': 'fca80e7e-4611-4eb8-88e7-a98ffbcc06a4'} Jul 17 19:53:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:53:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:53:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Acquiring lock "cinder-quobyte-fca80e7e-4611-4eb8-88e7-a98ffbcc06a4-55b351c7-e15d-4110-a6f7-1f735e199ed0" by "_create_volume_from_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:53:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Lock "cinder-quobyte-fca80e7e-4611-4eb8-88e7-a98ffbcc06a4-55b351c7-e15d-4110-a6f7-1f735e199ed0" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:53:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Creating volume 55b351c7-e15d-4110-a6f7-1f735e199ed0 from snapshot fca80e7e-4611-4eb8-88e7-a98ffbcc06a4 {{(pid=87726) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 19:53:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:53:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:53:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:53:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:53:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:53:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:53:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Acquiring lock "cinder-quobyte-55b351c7-e15d-4110-a6f7-1f735e199ed0" by "_copy_volume_from_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:53:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Lock "cinder-quobyte-55b351c7-e15d-4110-a6f7-1f735e199ed0" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:53:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] snapshot: fca80e7e-4611-4eb8-88e7-a98ffbcc06a4, volume: 55b351c7-e15d-4110-a6f7-1f735e199ed0, {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 19:53:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:53:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:53:38 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:53:38 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:53:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:53:38 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a73ef9-dd1b-45e0-8ce1-e6a146154084]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:53:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2.fca80e7e-4611-4eb8-88e7-a98ffbcc06a4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:38 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2.fca80e7e-4611-4eb8-88e7-a98ffbcc06a4 Jul 17 19:53:38 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:38 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2.fca80e7e-4611-4eb8-88e7-a98ffbcc06a4" returned: 0 in 0.342s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:38 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69ee048a-5144-4090-816a-8f71ada769c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:53:38 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2 {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 19:53:38 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Creating direct copy from snapshot {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 19:53:38 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfdb8aa-67e7-4a7a-bd0d-5ceeeccf8f64]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:53:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:38 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2 Jul 17 19:53:38 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:38 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2" returned: 0 in 0.347s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:38 devstack cinder-volume[87726]: DEBUG cinder.utils [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Path /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-55b351c7-e15d-4110-a6f7-1f735e199ed0 not found in is_blk_device check {{(pid=87726) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 19:53:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-55b351c7-e15d-4110-a6f7-1f735e199ed0 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:38 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-55b351c7-e15d-4110-a6f7-1f735e199ed0 Jul 17 19:53:38 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:42 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-55b351c7-e15d-4110-a6f7-1f735e199ed0" returned: 0 in 3.949s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:42 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[f398cedf-8e9e-418c-a6c9-b3270a02e5a4]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:53:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:42 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2 Jul 17 19:53:42 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:43 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2" returned: 0 in 0.539s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:43 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Image conversion details: src /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2, size 1024.00 MB, duration 3.95 sec, destination /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-55b351c7-e15d-4110-a6f7-1f735e199ed0 {{(pid=87726) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 19:53:43 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Converted 1024.00 MB image at 259.20 MB/s Jul 17 19:53:43 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-55b351c7-e15d-4110-a6f7-1f735e199ed0 is being set with open permissions: ugo+rw Jul 17 19:53:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-55b351c7-e15d-4110-a6f7-1f735e199ed0 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:43 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-55b351c7-e15d-4110-a6f7-1f735e199ed0 Jul 17 19:53:43 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:43 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-55b351c7-e15d-4110-a6f7-1f735e199ed0" returned: 0 in 0.240s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:43 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Lock "cinder-quobyte-55b351c7-e15d-4110-a6f7-1f735e199ed0" released by "_copy_volume_from_snapshot" :: held 5.495s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:53:43 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Lock "cinder-quobyte-fca80e7e-4611-4eb8-88e7-a98ffbcc06a4-55b351c7-e15d-4110-a6f7-1f735e199ed0" released by "_create_volume_from_snapshot" :: held 5.521s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:53:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.536s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:53:43 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4004bddf-fbe3-4380-a594-1518afe42f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55b351c7-e15d-4110-a6f7-1f735e199ed0', 'volume_size': 1, 'snapshot_id': 'fca80e7e-4611-4eb8-88e7-a98ffbcc06a4'}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:53:43 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e91648-fa97-481f-afdf-d508464c1ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:53:43 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Volume volume-55b351c7-e15d-4110-a6f7-1f735e199ed0 (55b351c7-e15d-4110-a6f7-1f735e199ed0): created successfully Jul 17 19:53:43 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e91648-fa97-481f-afdf-d508464c1ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:53:43 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Flow 'volume_create_manager' (12447cba-39d3-45f7-8078-ca42b594977b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:53:43 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-266bde35-926e-4839-bd96-8db621493e1c tempest-VolumeDependencyTests-1861584587 None] Created volume successfully. Jul 17 19:53:44 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1272c450-99fc-405a-8aa3-529ebb076e78 tempest-VolumeDependencyTests-1861584587 None] Acquiring lock "cinder-fca80e7e-4611-4eb8-88e7-a98ffbcc06a4-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:53:44 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1272c450-99fc-405a-8aa3-529ebb076e78 tempest-VolumeDependencyTests-1861584587 None] Lock "cinder-fca80e7e-4611-4eb8-88e7-a98ffbcc06a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:53:44 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1272c450-99fc-405a-8aa3-529ebb076e78 tempest-VolumeDependencyTests-1861584587 None] Acquiring lock "cinder-quobyte-69ee048a-5144-4090-816a-8f71ada769c2" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:53:44 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1272c450-99fc-405a-8aa3-529ebb076e78 tempest-VolumeDependencyTests-1861584587 None] Lock "cinder-quobyte-69ee048a-5144-4090-816a-8f71ada769c2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:53:44 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1272c450-99fc-405a-8aa3-529ebb076e78 tempest-VolumeDependencyTests-1861584587 None] Acquiring lock "cinder-quobyte-fca80e7e-4611-4eb8-88e7-a98ffbcc06a4" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:53:44 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1272c450-99fc-405a-8aa3-529ebb076e78 tempest-VolumeDependencyTests-1861584587 None] Lock "cinder-quobyte-fca80e7e-4611-4eb8-88e7-a98ffbcc06a4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:53:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-1272c450-99fc-405a-8aa3-529ebb076e78 tempest-VolumeDependencyTests-1861584587 None] Deleting offline snapshot fca80e7e-4611-4eb8-88e7-a98ffbcc06a4 of volume 69ee048a-5144-4090-816a-8f71ada769c2 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:53:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-1272c450-99fc-405a-8aa3-529ebb076e78 tempest-VolumeDependencyTests-1861584587 None] snapshot_file for this snap is: volume-69ee048a-5144-4090-816a-8f71ada769c2.fca80e7e-4611-4eb8-88e7-a98ffbcc06a4 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:53:44 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba241824-3409-48dc-ae52-f42e5985b24a]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:53:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1272c450-99fc-405a-8aa3-529ebb076e78 tempest-VolumeDependencyTests-1861584587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2.fca80e7e-4611-4eb8-88e7-a98ffbcc06a4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:44 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2.fca80e7e-4611-4eb8-88e7-a98ffbcc06a4 Jul 17 19:53:44 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:44 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1272c450-99fc-405a-8aa3-529ebb076e78 tempest-VolumeDependencyTests-1861584587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2.fca80e7e-4611-4eb8-88e7-a98ffbcc06a4" returned: 0 in 0.339s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-1272c450-99fc-405a-8aa3-529ebb076e78 tempest-VolumeDependencyTests-1861584587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69ee048a-5144-4090-816a-8f71ada769c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:53:44 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da092ca-3827-47df-8fbc-e3230e224448]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:53:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1272c450-99fc-405a-8aa3-529ebb076e78 tempest-VolumeDependencyTests-1861584587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:45 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2 Jul 17 19:53:45 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:45 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1272c450-99fc-405a-8aa3-529ebb076e78 tempest-VolumeDependencyTests-1861584587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2" returned: 0 in 0.339s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1272c450-99fc-405a-8aa3-529ebb076e78 tempest-VolumeDependencyTests-1861584587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2.fca80e7e-4611-4eb8-88e7-a98ffbcc06a4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:45 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2.fca80e7e-4611-4eb8-88e7-a98ffbcc06a4 Jul 17 19:53:45 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:45 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1272c450-99fc-405a-8aa3-529ebb076e78 tempest-VolumeDependencyTests-1861584587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2.fca80e7e-4611-4eb8-88e7-a98ffbcc06a4" returned: 0 in 0.324s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1272c450-99fc-405a-8aa3-529ebb076e78 tempest-VolumeDependencyTests-1861584587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2.fca80e7e-4611-4eb8-88e7-a98ffbcc06a4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:45 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2.fca80e7e-4611-4eb8-88e7-a98ffbcc06a4 Jul 17 19:53:45 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:45 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1272c450-99fc-405a-8aa3-529ebb076e78 tempest-VolumeDependencyTests-1861584587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2.fca80e7e-4611-4eb8-88e7-a98ffbcc06a4" returned: 0 in 0.235s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:45 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1272c450-99fc-405a-8aa3-529ebb076e78 tempest-VolumeDependencyTests-1861584587 None] Lock "cinder-quobyte-fca80e7e-4611-4eb8-88e7-a98ffbcc06a4" released by "_delete_snapshot" :: held 1.328s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:53:45 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1272c450-99fc-405a-8aa3-529ebb076e78 tempest-VolumeDependencyTests-1861584587 None] Lock "cinder-quobyte-69ee048a-5144-4090-816a-8f71ada769c2" released by "delete_snapshot" :: held 1.350s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:53:45 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-1272c450-99fc-405a-8aa3-529ebb076e78 tempest-VolumeDependencyTests-1861584587 None] Created reservations ['c5433258-ca73-4d2e-a26d-e9fb6d2e5b10', 'fdda5ddf-74a9-44d0-9d79-f20ddd842b17', '38568d12-fb46-41ac-8fda-981f5507d4c1', '47e8ba6e-8776-46a2-b26d-3f43bdc8a89c'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:53:45 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-1272c450-99fc-405a-8aa3-529ebb076e78 tempest-VolumeDependencyTests-1861584587 None] Delete snapshot completed successfully. Jul 17 19:53:45 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1272c450-99fc-405a-8aa3-529ebb076e78 tempest-VolumeDependencyTests-1861584587 None] Lock "cinder-fca80e7e-4611-4eb8-88e7-a98ffbcc06a4-delete_snapshot" released by "delete_snapshot" :: held 1.474s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:53:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-10db9001-75b7-4980-9907-fff8c494489d tempest-VolumeDependencyTests-1861584587 None] Acquiring lock "cinder-69ee048a-5144-4090-816a-8f71ada769c2-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:53:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-10db9001-75b7-4980-9907-fff8c494489d tempest-VolumeDependencyTests-1861584587 None] Lock "cinder-69ee048a-5144-4090-816a-8f71ada769c2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:53:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-10db9001-75b7-4980-9907-fff8c494489d tempest-VolumeDependencyTests-1861584587 None] Acquiring lock "cinder-quobyte-69ee048a-5144-4090-816a-8f71ada769c2" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:53:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-10db9001-75b7-4980-9907-fff8c494489d tempest-VolumeDependencyTests-1861584587 None] Lock "cinder-quobyte-69ee048a-5144-4090-816a-8f71ada769c2" acquired by "delete_volume" :: waited 0.016s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:53:46 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[f534abbb-b2f9-4ef7-8985-702194bcc20b]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:53:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-10db9001-75b7-4980-9907-fff8c494489d tempest-VolumeDependencyTests-1861584587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:46 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2 Jul 17 19:53:46 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:47 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-10db9001-75b7-4980-9907-fff8c494489d tempest-VolumeDependencyTests-1861584587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2" returned: 0 in 0.341s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-10db9001-75b7-4980-9907-fff8c494489d tempest-VolumeDependencyTests-1861584587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:47 devstack sudo[104917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2 Jul 17 19:53:47 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:47 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-10db9001-75b7-4980-9907-fff8c494489d tempest-VolumeDependencyTests-1861584587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69ee048a-5144-4090-816a-8f71ada769c2" returned: 0 in 0.241s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-10db9001-75b7-4980-9907-fff8c494489d tempest-VolumeDependencyTests-1861584587 None] Lock "cinder-quobyte-69ee048a-5144-4090-816a-8f71ada769c2" released by "delete_volume" :: held 0.638s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:53:47 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-10db9001-75b7-4980-9907-fff8c494489d tempest-VolumeDependencyTests-1861584587 None] Created reservations ['e5956e95-81ff-4c84-9385-44ae1c0013c9', '89d07c43-03b0-436b-b736-5262ff06b6fa', 'c5abd8ed-13f0-49ab-ac05-6d214c72b232', '936a0f17-f191-4e7e-95f0-eb9c68bda023'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:53:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-10db9001-75b7-4980-9907-fff8c494489d tempest-VolumeDependencyTests-1861584587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:53:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-10db9001-75b7-4980-9907-fff8c494489d tempest-VolumeDependencyTests-1861584587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:53:47 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-10db9001-75b7-4980-9907-fff8c494489d tempest-VolumeDependencyTests-1861584587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:53:47 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-10db9001-75b7-4980-9907-fff8c494489d tempest-VolumeDependencyTests-1861584587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:53:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-10db9001-75b7-4980-9907-fff8c494489d tempest-VolumeDependencyTests-1861584587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:53:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-10db9001-75b7-4980-9907-fff8c494489d tempest-VolumeDependencyTests-1861584587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:47 devstack sudo[104920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:53:47 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:47 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-10db9001-75b7-4980-9907-fff8c494489d tempest-VolumeDependencyTests-1861584587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.243s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:47 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-10db9001-75b7-4980-9907-fff8c494489d tempest-VolumeDependencyTests-1861584587 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:53:47 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-10db9001-75b7-4980-9907-fff8c494489d tempest-VolumeDependencyTests-1861584587 None] Deleted volume successfully. Jul 17 19:53:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-10db9001-75b7-4980-9907-fff8c494489d tempest-VolumeDependencyTests-1861584587 None] Lock "cinder-69ee048a-5144-4090-816a-8f71ada769c2-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:53:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0539fbd5-8cc7-4138-a3a2-20ac98094d61 tempest-VolumeDependencyTests-1861584587 None] Acquiring lock "cinder-55b351c7-e15d-4110-a6f7-1f735e199ed0-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:53:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0539fbd5-8cc7-4138-a3a2-20ac98094d61 tempest-VolumeDependencyTests-1861584587 None] Lock "cinder-55b351c7-e15d-4110-a6f7-1f735e199ed0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:53:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0539fbd5-8cc7-4138-a3a2-20ac98094d61 tempest-VolumeDependencyTests-1861584587 None] Acquiring lock "cinder-quobyte-55b351c7-e15d-4110-a6f7-1f735e199ed0" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:53:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0539fbd5-8cc7-4138-a3a2-20ac98094d61 tempest-VolumeDependencyTests-1861584587 None] Lock "cinder-quobyte-55b351c7-e15d-4110-a6f7-1f735e199ed0" acquired by "delete_volume" :: waited 0.014s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:53:47 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[1287b0c8-8606-44d6-a6be-804a73c505a9]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:53:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0539fbd5-8cc7-4138-a3a2-20ac98094d61 tempest-VolumeDependencyTests-1861584587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-55b351c7-e15d-4110-a6f7-1f735e199ed0 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:47 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-55b351c7-e15d-4110-a6f7-1f735e199ed0 Jul 17 19:53:47 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:48 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0539fbd5-8cc7-4138-a3a2-20ac98094d61 tempest-VolumeDependencyTests-1861584587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-55b351c7-e15d-4110-a6f7-1f735e199ed0" returned: 0 in 0.358s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0539fbd5-8cc7-4138-a3a2-20ac98094d61 tempest-VolumeDependencyTests-1861584587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-55b351c7-e15d-4110-a6f7-1f735e199ed0 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:48 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-55b351c7-e15d-4110-a6f7-1f735e199ed0 Jul 17 19:53:48 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:48 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0539fbd5-8cc7-4138-a3a2-20ac98094d61 tempest-VolumeDependencyTests-1861584587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-55b351c7-e15d-4110-a6f7-1f735e199ed0" returned: 0 in 0.264s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:48 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0539fbd5-8cc7-4138-a3a2-20ac98094d61 tempest-VolumeDependencyTests-1861584587 None] Lock "cinder-quobyte-55b351c7-e15d-4110-a6f7-1f735e199ed0" released by "delete_volume" :: held 0.661s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:53:48 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-0539fbd5-8cc7-4138-a3a2-20ac98094d61 tempest-VolumeDependencyTests-1861584587 None] Created reservations ['c7c3c080-5ce9-43a5-ac16-a87db39d5761', '6a58332a-83ca-4bb8-b3a6-fe80d6158564', '036ce420-639d-4792-85f1-4595d35b7a07', 'a989fcea-d024-407f-9d18-f3ca6c395b17'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:53:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0539fbd5-8cc7-4138-a3a2-20ac98094d61 tempest-VolumeDependencyTests-1861584587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:53:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0539fbd5-8cc7-4138-a3a2-20ac98094d61 tempest-VolumeDependencyTests-1861584587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:53:48 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0539fbd5-8cc7-4138-a3a2-20ac98094d61 tempest-VolumeDependencyTests-1861584587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:53:48 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0539fbd5-8cc7-4138-a3a2-20ac98094d61 tempest-VolumeDependencyTests-1861584587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:53:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0539fbd5-8cc7-4138-a3a2-20ac98094d61 tempest-VolumeDependencyTests-1861584587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:53:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0539fbd5-8cc7-4138-a3a2-20ac98094d61 tempest-VolumeDependencyTests-1861584587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:48 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:53:48 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:48 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0539fbd5-8cc7-4138-a3a2-20ac98094d61 tempest-VolumeDependencyTests-1861584587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.240s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:48 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-0539fbd5-8cc7-4138-a3a2-20ac98094d61 tempest-VolumeDependencyTests-1861584587 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:53:48 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-0539fbd5-8cc7-4138-a3a2-20ac98094d61 tempest-VolumeDependencyTests-1861584587 None] Deleted volume successfully. Jul 17 19:53:48 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0539fbd5-8cc7-4138-a3a2-20ac98094d61 tempest-VolumeDependencyTests-1861584587 None] Lock "cinder-55b351c7-e15d-4110-a6f7-1f735e199ed0-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:53:54 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:53:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Flow 'volume_create_manager' (ba5ce76a-7449-4381-bb97-ee3ddf1c0a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:53:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12675a92-759c-4e21-bdec-3ca4f25f1df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:53:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12675a92-759c-4e21-bdec-3ca4f25f1df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b07a52-a923-48a5-bc41-ec15828bb99c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e3afd7dc60b4366af8369b51269a425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:53:54Z,use_quota=True,user_id='5964b5bda8ee49e29043a78940c18b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:53:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27ae4d4b-0782-4ae4-9d04-862751bafb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:53:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27ae4d4b-0782-4ae4-9d04-862751bafb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:53:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cedf9381-d23e-4017-b7a2-833d17f62afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:53:54 devstack cinder-volume[87726]: DEBUG cinder.image.glance [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Creating Keystone auth plugin from conf {{(pid=87726) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 19:53:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cedf9381-d23e-4017-b7a2-833d17f62afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '87b07a52-a923-48a5-bc41-ec15828bb99c', 'volume_name': 'volume-87b07a52-a923-48a5-bc41-ec15828bb99c', 'volume_size': 1, 'image_id': 'bee7b003-b4a6-4029-b78a-a6ce2d141ff3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bee7b003-b4a6-4029-b78a-a6ce2d141ff3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3a44555cb6f3d6eb5f77b20611f9160f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2e3afd7dc60b4366af8369b51269a425', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a75e7c6ac23b33535c3d78694cf2bd4a305a75b81cae830a99f903f938bbaf515a524a874a431f9cdc65c90494d148702ab854bb80e86e4a79030c2caf81ec5', 'id': 'bee7b003-b4a6-4029-b78a-a6ce2d141ff3', 'created_at': datetime.datetime(2026, 7, 17, 17, 53, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 17, 53, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bee7b003-b4a6-4029-b78a-a6ce2d141ff3/file', 'properties': {}}, 'image_service': }' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:53:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3d441ff-cd03-4b17-b70e-9b2810eaac70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:53:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3d441ff-cd03-4b17-b70e-9b2810eaac70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:53:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af013370-795f-452d-b326-aff699b5fc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:53:54 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Volume 87b07a52-a923-48a5-bc41-ec15828bb99c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-87b07a52-a923-48a5-bc41-ec15828bb99c', 'volume_size': 1, 'image_id': 'bee7b003-b4a6-4029-b78a-a6ce2d141ff3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bee7b003-b4a6-4029-b78a-a6ce2d141ff3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3a44555cb6f3d6eb5f77b20611f9160f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2e3afd7dc60b4366af8369b51269a425', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a75e7c6ac23b33535c3d78694cf2bd4a305a75b81cae830a99f903f938bbaf515a524a874a431f9cdc65c90494d148702ab854bb80e86e4a79030c2caf81ec5', 'id': 'bee7b003-b4a6-4029-b78a-a6ce2d141ff3', 'created_at': datetime.datetime(2026, 7, 17, 17, 53, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 17, 53, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bee7b003-b4a6-4029-b78a-a6ce2d141ff3/file', 'properties': {}}, 'image_service': } Jul 17 19:53:54 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Trying to clone 87b07a52-a923-48a5-bc41-ec15828bb99c from image bee7b003-b4a6-4029-b78a-a6ce2d141ff3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bee7b003-b4a6-4029-b78a-a6ce2d141ff3', 'metadata': {}}]). {{(pid=87726) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 19:53:54 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_k1vr__zfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87726) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 19:53:54 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Image download 0.00 MB at 0.00 MB/s Jul 17 19:53:54 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da0101f-3546-48c4-9134-f31056cf0b48]: (4, 'raw') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:53:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_k1vr__zfdevstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:54 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_k1vr__zfdevstack@QuobyteHD Jul 17 19:53:54 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:54 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_k1vr__zfdevstack@QuobyteHD" returned: 0 in 0.323s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_k1vr__zfdevstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:54 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_k1vr__zfdevstack@QuobyteHD Jul 17 19:53:54 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:55 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_k1vr__zfdevstack@QuobyteHD" returned: 1 in 0.325s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_k1vr__zfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 19:53:55 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Temporary image bee7b003-b4a6-4029-b78a-a6ce2d141ff3 is fetched for user 5964b5bda8ee49e29043a78940c18b4f. {{(pid=87726) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 19:53:55 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cde8314-64f2-45c1-ac40-8fe2a3fbccbb]: (4, 'raw') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:53:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_k1vr__zfdevstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:55 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_k1vr__zfdevstack@QuobyteHD Jul 17 19:53:55 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:55 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_k1vr__zfdevstack@QuobyteHD" returned: 0 in 0.321s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_k1vr__zfdevstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:55 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_k1vr__zfdevstack@QuobyteHD Jul 17 19:53:55 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:55 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_k1vr__zfdevstack@QuobyteHD" returned: 1 in 0.320s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_k1vr__zfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 19:53:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:53:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:53:55 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b07a52-a923-48a5-bc41-ec15828bb99c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e3afd7dc60b4366af8369b51269a425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:53:54Z,use_quota=True,user_id='5964b5bda8ee49e29043a78940c18b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:53:55 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Creating volume 87b07a52-a923-48a5-bc41-ec15828bb99c {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:53:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:53:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:53:55 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:53:55 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:53:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:53:55 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:53:55 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:53:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87b07a52-a923-48a5-bc41-ec15828bb99c 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:55 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87b07a52-a923-48a5-bc41-ec15828bb99c 1073741824 Jul 17 19:53:55 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:56 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87b07a52-a923-48a5-bc41-ec15828bb99c 1073741824" returned: 0 in 0.402s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87b07a52-a923-48a5-bc41-ec15828bb99c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:56 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87b07a52-a923-48a5-bc41-ec15828bb99c Jul 17 19:53:56 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:56 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87b07a52-a923-48a5-bc41-ec15828bb99c" returned: 0 in 0.237s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:56 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:53:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:53:56 devstack cinder-volume[87726]: DEBUG cinder.volume.volume_utils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Attempting download of bee7b003-b4a6-4029-b78a-a6ce2d141ff3 ((None, [{'url': 'file:///opt/stack/data/glance/images/bee7b003-b4a6-4029-b78a-a6ce2d141ff3', 'metadata': {}}])) to volume 87b07a52-a923-48a5-bc41-ec15828bb99c. {{(pid=87726) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 19:53:56 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[793d643e-6c24-4ff4-9fb3-c9017e3220bb]: (4, 'raw') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:53:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_i524krun {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:56 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_i524krun Jul 17 19:53:56 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:56 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_i524krun" returned: 0 in 0.319s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_i524krun {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:57 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_i524krun Jul 17 19:53:57 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:57 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_i524krun" returned: 1 in 0.325s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_i524krun' failed. Not Retrying. {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 19:53:57 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca44a4cc-209b-47f0-af63-7d46c1f104e0]: (4, 'raw') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:53:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_k1vr__zfdevstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:57 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_k1vr__zfdevstack@QuobyteHD Jul 17 19:53:57 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:57 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_k1vr__zfdevstack@QuobyteHD" returned: 0 in 0.312s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_k1vr__zfdevstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:57 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_k1vr__zfdevstack@QuobyteHD Jul 17 19:53:57 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:57 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_k1vr__zfdevstack@QuobyteHD" returned: 1 in 0.317s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_k1vr__zfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 19:53:57 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] bee7b003-b4a6-4029-b78a-a6ce2d141ff3 was raw, converting to qcow2 {{(pid=87726) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 19:53:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_k1vr__zfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87b07a52-a923-48a5-bc41-ec15828bb99c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:57 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_k1vr__zfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87b07a52-a923-48a5-bc41-ec15828bb99c Jul 17 19:53:57 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:58 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_k1vr__zfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87b07a52-a923-48a5-bc41-ec15828bb99c" returned: 0 in 0.427s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:58 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bee7b003-b4a6-4029-b78a-a6ce2d141ff3_k1vr__zfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87b07a52-a923-48a5-bc41-ec15828bb99c {{(pid=87726) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 19:53:58 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Converted 0.00 MB image at 0.00 MB/s Jul 17 19:53:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87b07a52-a923-48a5-bc41-ec15828bb99c 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:58 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87b07a52-a923-48a5-bc41-ec15828bb99c 1G Jul 17 19:53:58 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:58 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87b07a52-a923-48a5-bc41-ec15828bb99c 1G" returned: 0 in 0.312s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:58 devstack cinder-volume[87726]: DEBUG cinder.volume.volume_utils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Downloaded image bee7b003-b4a6-4029-b78a-a6ce2d141ff3 ((None, [{'url': 'file:///opt/stack/data/glance/images/bee7b003-b4a6-4029-b78a-a6ce2d141ff3', 'metadata': {}}])) to volume 87b07a52-a923-48a5-bc41-ec15828bb99c successfully. {{(pid=87726) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 19:53:58 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Temporary image bee7b003-b4a6-4029-b78a-a6ce2d141ff3 for user 5964b5bda8ee49e29043a78940c18b4f is deleted. {{(pid=87726) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 19:53:58 devstack cinder-volume[87726]: DEBUG cinder.volume.volume_utils [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Marking volume 87b07a52-a923-48a5-bc41-ec15828bb99c as bootable. {{(pid=87726) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 19:53:58 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Copying metadata from image bee7b003-b4a6-4029-b78a-a6ce2d141ff3 to 87b07a52-a923-48a5-bc41-ec15828bb99c. {{(pid=87726) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 19:53:58 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Creating volume glance metadata for volume 87b07a52-a923-48a5-bc41-ec15828bb99c backed by image bee7b003-b4a6-4029-b78a-a6ce2d141ff3 with: {'image_id': 'bee7b003-b4a6-4029-b78a-a6ce2d141ff3', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '3a44555cb6f3d6eb5f77b20611f9160f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87726) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 19:53:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af013370-795f-452d-b326-aff699b5fc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87b07a52-a923-48a5-bc41-ec15828bb99c', 'volume_size': 1, 'image_id': 'bee7b003-b4a6-4029-b78a-a6ce2d141ff3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bee7b003-b4a6-4029-b78a-a6ce2d141ff3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3a44555cb6f3d6eb5f77b20611f9160f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2e3afd7dc60b4366af8369b51269a425', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a75e7c6ac23b33535c3d78694cf2bd4a305a75b81cae830a99f903f938bbaf515a524a874a431f9cdc65c90494d148702ab854bb80e86e4a79030c2caf81ec5', 'id': 'bee7b003-b4a6-4029-b78a-a6ce2d141ff3', 'created_at': datetime.datetime(2026, 7, 17, 17, 53, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 17, 53, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bee7b003-b4a6-4029-b78a-a6ce2d141ff3/file', 'properties': {}}, 'image_service': }' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:53:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c67ed4-cd00-48b8-bcdc-572e537fba01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:53:58 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Volume volume-87b07a52-a923-48a5-bc41-ec15828bb99c (87b07a52-a923-48a5-bc41-ec15828bb99c): created successfully Jul 17 19:53:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c67ed4-cd00-48b8-bcdc-572e537fba01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:53:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Flow 'volume_create_manager' (ba5ce76a-7449-4381-bb97-ee3ddf1c0a4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:53:58 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-8ac7960e-d0b6-4439-8eff-1bfead9278e6 tempest-VolumeImageDependencyTests-1750550271 None] Created volume successfully. Jul 17 19:53:59 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-95cd9681-6181-4aef-b7e3-2f278089e352 tempest-VolumeImageDependencyTests-1750550271 None] Acquiring lock "cinder-87b07a52-a923-48a5-bc41-ec15828bb99c-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:53:59 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-95cd9681-6181-4aef-b7e3-2f278089e352 tempest-VolumeImageDependencyTests-1750550271 None] Lock "cinder-87b07a52-a923-48a5-bc41-ec15828bb99c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:53:59 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-95cd9681-6181-4aef-b7e3-2f278089e352 tempest-VolumeImageDependencyTests-1750550271 None] Acquiring lock "cinder-quobyte-87b07a52-a923-48a5-bc41-ec15828bb99c" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:53:59 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-95cd9681-6181-4aef-b7e3-2f278089e352 tempest-VolumeImageDependencyTests-1750550271 None] Lock "cinder-quobyte-87b07a52-a923-48a5-bc41-ec15828bb99c" acquired by "delete_volume" :: waited 0.015s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:53:59 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cfaf84-742b-4ea5-b635-be8578d20643]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:53:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-95cd9681-6181-4aef-b7e3-2f278089e352 tempest-VolumeImageDependencyTests-1750550271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87b07a52-a923-48a5-bc41-ec15828bb99c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:59 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87b07a52-a923-48a5-bc41-ec15828bb99c Jul 17 19:53:59 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:59 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Jul 17 19:53:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-95cd9681-6181-4aef-b7e3-2f278089e352 tempest-VolumeImageDependencyTests-1750550271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87b07a52-a923-48a5-bc41-ec15828bb99c" returned: 0 in 0.347s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:53:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-95cd9681-6181-4aef-b7e3-2f278089e352 tempest-VolumeImageDependencyTests-1750550271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87b07a52-a923-48a5-bc41-ec15828bb99c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:53:59 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87b07a52-a923-48a5-bc41-ec15828bb99c Jul 17 19:53:59 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:53:59 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-95cd9681-6181-4aef-b7e3-2f278089e352 tempest-VolumeImageDependencyTests-1750550271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-87b07a52-a923-48a5-bc41-ec15828bb99c" returned: 0 in 0.238s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:00 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-95cd9681-6181-4aef-b7e3-2f278089e352 tempest-VolumeImageDependencyTests-1750550271 None] Lock "cinder-quobyte-87b07a52-a923-48a5-bc41-ec15828bb99c" released by "delete_volume" :: held 0.621s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:54:00 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-95cd9681-6181-4aef-b7e3-2f278089e352 tempest-VolumeImageDependencyTests-1750550271 None] Created reservations ['d58f5174-b793-4a76-8a91-f5669f4fe48e', '20b2c57f-1f12-4196-bfeb-28c725434885', 'b96524f3-5043-4202-82f2-7c40f35d8762', '36fd015a-6a3a-4933-ad60-29840af31dc5'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:54:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-95cd9681-6181-4aef-b7e3-2f278089e352 tempest-VolumeImageDependencyTests-1750550271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:54:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-95cd9681-6181-4aef-b7e3-2f278089e352 tempest-VolumeImageDependencyTests-1750550271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:54:00 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-95cd9681-6181-4aef-b7e3-2f278089e352 tempest-VolumeImageDependencyTests-1750550271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:54:00 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-95cd9681-6181-4aef-b7e3-2f278089e352 tempest-VolumeImageDependencyTests-1750550271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:54:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-95cd9681-6181-4aef-b7e3-2f278089e352 tempest-VolumeImageDependencyTests-1750550271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:54:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-95cd9681-6181-4aef-b7e3-2f278089e352 tempest-VolumeImageDependencyTests-1750550271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:00 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:54:00 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:00 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-95cd9681-6181-4aef-b7e3-2f278089e352 tempest-VolumeImageDependencyTests-1750550271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.241s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:00 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-95cd9681-6181-4aef-b7e3-2f278089e352 tempest-VolumeImageDependencyTests-1750550271 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:54:00 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-95cd9681-6181-4aef-b7e3-2f278089e352 tempest-VolumeImageDependencyTests-1750550271 None] Deleted volume successfully. Jul 17 19:54:00 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-95cd9681-6181-4aef-b7e3-2f278089e352 tempest-VolumeImageDependencyTests-1750550271 None] Lock "cinder-87b07a52-a923-48a5-bc41-ec15828bb99c-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:54:10 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=40,cinder:INSERT=13,cinder:UPDATE=52,cinder:DELETE=5 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:54:10 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=44,cinder:UPDATE=45,cinder:INSERT=19,cinder:DELETE=3 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:54:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:54:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:54:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:54:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:54:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:54:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:54:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:15 devstack sudo[105050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:54:15 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:15 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.246s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:15 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:54:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager._thread_info {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:54:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread count: 28 {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 19:54:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread info: [<_MainThread(MainThread, started 130066227544192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 19:54:22 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] Flow 'volume_create_manager' (8aef210f-270e-4ba5-9c99-6b56b854a130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d317cf7d-27a5-4bde-abf3-d4f11ea47976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d317cf7d-27a5-4bde-abf3-d4f11ea47976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-750347844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f946cd1-de56-450d-9c11-f43729708953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b1011232dcf431c8cd3f4959c64cfcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:54:23Z,use_quota=True,user_id='8b3397492077474ea78452be735b08f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e0b59e6-d959-4a2b-8606-03e9a2b1f69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e0b59e6-d959-4a2b-8606-03e9a2b1f69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d60283-73cd-485d-a3a3-fe89f2ccfff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d60283-73cd-485d-a3a3-fe89f2ccfff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f946cd1-de56-450d-9c11-f43729708953', 'volume_name': 'volume-5f946cd1-de56-450d-9c11-f43729708953', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c47725f-1aa0-4c74-b041-850e15bf91a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c47725f-1aa0-4c74-b041-850e15bf91a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c38ee6b-36fc-4cb5-8aea-0d96cba42ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:23 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] Volume 5f946cd1-de56-450d-9c11-f43729708953: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f946cd1-de56-450d-9c11-f43729708953', 'volume_size': 1} Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-750347844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f946cd1-de56-450d-9c11-f43729708953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b1011232dcf431c8cd3f4959c64cfcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:54:23Z,use_quota=True,user_id='8b3397492077474ea78452be735b08f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] Creating volume 5f946cd1-de56-450d-9c11-f43729708953 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:54:23 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:23 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953 1073741824 Jul 17 19:54:23 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:23 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953 1073741824" returned: 0 in 0.406s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:23 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953 Jul 17 19:54:23 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:23 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953" returned: 0 in 0.236s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c38ee6b-36fc-4cb5-8aea-0d96cba42ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f946cd1-de56-450d-9c11-f43729708953', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1334d35a-0321-42c8-9360-e52c6b4c217f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:23 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] Volume volume-5f946cd1-de56-450d-9c11-f43729708953 (5f946cd1-de56-450d-9c11-f43729708953): created successfully Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1334d35a-0321-42c8-9360-e52c6b4c217f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] Flow 'volume_create_manager' (8aef210f-270e-4ba5-9c99-6b56b854a130) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:54:23 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-311a13d1-f885-4610-9c04-85cc9c95cecf tempest-SnapshotDependencyTests-639947689 None] Created volume successfully. Jul 17 19:54:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f92c86a6-8f5a-4515-95b6-18f924e555b0 tempest-SnapshotDependencyTests-639947689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:54:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f92c86a6-8f5a-4515-95b6-18f924e555b0 tempest-SnapshotDependencyTests-639947689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:54:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-f92c86a6-8f5a-4515-95b6-18f924e555b0 tempest-SnapshotDependencyTests-639947689 None] Creating offline snapshot 9dc3e6a0-b213-4185-ad6c-aa5531fff0c8 of volume 5f946cd1-de56-450d-9c11-f43729708953 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:54:24 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbac93fc-f5e3-4547-8447-2f9241031b71]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:54:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f92c86a6-8f5a-4515-95b6-18f924e555b0 tempest-SnapshotDependencyTests-639947689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:24 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953 Jul 17 19:54:24 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:24 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f92c86a6-8f5a-4515-95b6-18f924e555b0 tempest-SnapshotDependencyTests-639947689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953" returned: 0 in 0.353s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f92c86a6-8f5a-4515-95b6-18f924e555b0 tempest-SnapshotDependencyTests-639947689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953.9dc3e6a0-b213-4185-ad6c-aa5531fff0c8 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:24 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953.9dc3e6a0-b213-4185-ad6c-aa5531fff0c8 1G Jul 17 19:54:24 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:24 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f92c86a6-8f5a-4515-95b6-18f924e555b0 tempest-SnapshotDependencyTests-639947689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953.9dc3e6a0-b213-4185-ad6c-aa5531fff0c8 1G" returned: 0 in 0.379s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f92c86a6-8f5a-4515-95b6-18f924e555b0 tempest-SnapshotDependencyTests-639947689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f946cd1-de56-450d-9c11-f43729708953 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953.9dc3e6a0-b213-4185-ad6c-aa5531fff0c8 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:25 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f946cd1-de56-450d-9c11-f43729708953 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953.9dc3e6a0-b213-4185-ad6c-aa5531fff0c8 Jul 17 19:54:25 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:25 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f92c86a6-8f5a-4515-95b6-18f924e555b0 tempest-SnapshotDependencyTests-639947689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f946cd1-de56-450d-9c11-f43729708953 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953.9dc3e6a0-b213-4185-ad6c-aa5531fff0c8" returned: 0 in 0.277s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:25 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-f92c86a6-8f5a-4515-95b6-18f924e555b0 tempest-SnapshotDependencyTests-639947689 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953.9dc3e6a0-b213-4185-ad6c-aa5531fff0c8 is being set with open permissions: ugo+rw Jul 17 19:54:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f92c86a6-8f5a-4515-95b6-18f924e555b0 tempest-SnapshotDependencyTests-639947689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953.9dc3e6a0-b213-4185-ad6c-aa5531fff0c8 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:25 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953.9dc3e6a0-b213-4185-ad6c-aa5531fff0c8 Jul 17 19:54:25 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:25 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f92c86a6-8f5a-4515-95b6-18f924e555b0 tempest-SnapshotDependencyTests-639947689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953.9dc3e6a0-b213-4185-ad6c-aa5531fff0c8" returned: 0 in 0.236s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f92c86a6-8f5a-4515-95b6-18f924e555b0 tempest-SnapshotDependencyTests-639947689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:25 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953.info Jul 17 19:54:25 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:25 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f92c86a6-8f5a-4515-95b6-18f924e555b0 tempest-SnapshotDependencyTests-639947689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953.info" returned: 0 in 0.238s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:25 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-f92c86a6-8f5a-4515-95b6-18f924e555b0 tempest-SnapshotDependencyTests-639947689 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953.info is being set with open permissions: ugo+rw Jul 17 19:54:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f92c86a6-8f5a-4515-95b6-18f924e555b0 tempest-SnapshotDependencyTests-639947689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:25 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953.info Jul 17 19:54:25 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:26 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f92c86a6-8f5a-4515-95b6-18f924e555b0 tempest-SnapshotDependencyTests-639947689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953.info" returned: 0 in 0.231s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f92c86a6-8f5a-4515-95b6-18f924e555b0 tempest-SnapshotDependencyTests-639947689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.797s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:54:26 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-f92c86a6-8f5a-4515-95b6-18f924e555b0 tempest-SnapshotDependencyTests-639947689 None] Create snapshot completed successfully Jul 17 19:54:26 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:54:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Flow 'volume_create_manager' (44f6897c-5d39-4108-b4ee-1a8fe955af2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:54:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7559004f-0087-4175-ac3c-0247c9b4d3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7559004f-0087-4175-ac3c-0247c9b4d3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd230e1-8657-429d-a267-93e6db7cb7cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b1011232dcf431c8cd3f4959c64cfcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9dc3e6a0-b213-4185-ad6c-aa5531fff0c8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:54:27Z,use_quota=True,user_id='8b3397492077474ea78452be735b08f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (214f3fd2-c7f1-42ca-9ecf-66c9b737a875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (214f3fd2-c7f1-42ca-9ecf-66c9b737a875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f231ba-0b00-474e-b372-bfddc41389e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f231ba-0b00-474e-b372-bfddc41389e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2fd230e1-8657-429d-a267-93e6db7cb7cc', 'volume_name': 'volume-2fd230e1-8657-429d-a267-93e6db7cb7cc', 'volume_size': 1, 'snapshot_id': '9dc3e6a0-b213-4185-ad6c-aa5531fff0c8'}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5ae196f-50a5-45a2-b4da-3e802238cbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5ae196f-50a5-45a2-b4da-3e802238cbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c27d7d8c-df36-4d4d-8207-7cca5557fa3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:26 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Volume 2fd230e1-8657-429d-a267-93e6db7cb7cc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2fd230e1-8657-429d-a267-93e6db7cb7cc', 'volume_size': 1, 'snapshot_id': '9dc3e6a0-b213-4185-ad6c-aa5531fff0c8'} Jul 17 19:54:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:54:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:54:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Acquiring lock "cinder-quobyte-9dc3e6a0-b213-4185-ad6c-aa5531fff0c8-2fd230e1-8657-429d-a267-93e6db7cb7cc" by "_create_volume_from_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:54:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Lock "cinder-quobyte-9dc3e6a0-b213-4185-ad6c-aa5531fff0c8-2fd230e1-8657-429d-a267-93e6db7cb7cc" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:54:26 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Creating volume 2fd230e1-8657-429d-a267-93e6db7cb7cc from snapshot 9dc3e6a0-b213-4185-ad6c-aa5531fff0c8 {{(pid=87726) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 19:54:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:54:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:54:26 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:54:26 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:54:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:54:26 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:54:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Acquiring lock "cinder-quobyte-2fd230e1-8657-429d-a267-93e6db7cb7cc" by "_copy_volume_from_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:54:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Lock "cinder-quobyte-2fd230e1-8657-429d-a267-93e6db7cb7cc" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:54:27 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] snapshot: 9dc3e6a0-b213-4185-ad6c-aa5531fff0c8, volume: 2fd230e1-8657-429d-a267-93e6db7cb7cc, {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 19:54:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:54:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:54:27 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:54:27 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:54:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:54:27 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8cb6dd-3303-450d-b630-7b949cd1146e]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:54:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953.9dc3e6a0-b213-4185-ad6c-aa5531fff0c8 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:27 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953.9dc3e6a0-b213-4185-ad6c-aa5531fff0c8 Jul 17 19:54:27 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:27 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953.9dc3e6a0-b213-4185-ad6c-aa5531fff0c8" returned: 0 in 0.358s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:27 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f946cd1-de56-450d-9c11-f43729708953(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:54:27 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953 {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 19:54:27 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Creating direct copy from snapshot {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 19:54:27 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d0c3ad-81ec-4e35-91cc-92d06d104ec4]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:54:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:27 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953 Jul 17 19:54:27 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:27 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953" returned: 0 in 0.351s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:27 devstack cinder-volume[87726]: DEBUG cinder.utils [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Path /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fd230e1-8657-429d-a267-93e6db7cb7cc not found in is_blk_device check {{(pid=87726) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 19:54:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fd230e1-8657-429d-a267-93e6db7cb7cc {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:27 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fd230e1-8657-429d-a267-93e6db7cb7cc Jul 17 19:54:27 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:31 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fd230e1-8657-429d-a267-93e6db7cb7cc" returned: 0 in 4.009s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:31 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6951cd-45c1-4f23-9c74-4cc3a06ffe71]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:54:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:31 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953 Jul 17 19:54:31 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:32 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953" returned: 0 in 0.533s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:32 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Image conversion details: src /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953, size 1024.00 MB, duration 4.01 sec, destination /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fd230e1-8657-429d-a267-93e6db7cb7cc {{(pid=87726) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 19:54:32 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Converted 1024.00 MB image at 255.36 MB/s Jul 17 19:54:32 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fd230e1-8657-429d-a267-93e6db7cb7cc is being set with open permissions: ugo+rw Jul 17 19:54:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fd230e1-8657-429d-a267-93e6db7cb7cc {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:32 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fd230e1-8657-429d-a267-93e6db7cb7cc Jul 17 19:54:32 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:32 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fd230e1-8657-429d-a267-93e6db7cb7cc" returned: 0 in 0.238s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:32 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Lock "cinder-quobyte-2fd230e1-8657-429d-a267-93e6db7cb7cc" released by "_copy_volume_from_snapshot" :: held 5.572s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:54:32 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Lock "cinder-quobyte-9dc3e6a0-b213-4185-ad6c-aa5531fff0c8-2fd230e1-8657-429d-a267-93e6db7cb7cc" released by "_create_volume_from_snapshot" :: held 5.598s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:54:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.613s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:54:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c27d7d8c-df36-4d4d-8207-7cca5557fa3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fd230e1-8657-429d-a267-93e6db7cb7cc', 'volume_size': 1, 'snapshot_id': '9dc3e6a0-b213-4185-ad6c-aa5531fff0c8'}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (868051b0-f1f1-4e69-b7d1-c60be701d305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:32 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Volume volume-2fd230e1-8657-429d-a267-93e6db7cb7cc (2fd230e1-8657-429d-a267-93e6db7cb7cc): created successfully Jul 17 19:54:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (868051b0-f1f1-4e69-b7d1-c60be701d305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Flow 'volume_create_manager' (44f6897c-5d39-4108-b4ee-1a8fe955af2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:54:32 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-0a255355-8969-4d70-8f74-ff5570700ae4 tempest-SnapshotDependencyTests-639947689 None] Created volume successfully. Jul 17 19:54:33 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-87b88544-9397-4d02-9200-ab2347198334 tempest-SnapshotDependencyTests-639947689 None] Acquiring lock "cinder-9dc3e6a0-b213-4185-ad6c-aa5531fff0c8-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:54:33 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-87b88544-9397-4d02-9200-ab2347198334 tempest-SnapshotDependencyTests-639947689 None] Lock "cinder-9dc3e6a0-b213-4185-ad6c-aa5531fff0c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:54:33 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-87b88544-9397-4d02-9200-ab2347198334 tempest-SnapshotDependencyTests-639947689 None] Acquiring lock "cinder-quobyte-5f946cd1-de56-450d-9c11-f43729708953" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:54:33 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-87b88544-9397-4d02-9200-ab2347198334 tempest-SnapshotDependencyTests-639947689 None] Lock "cinder-quobyte-5f946cd1-de56-450d-9c11-f43729708953" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:54:33 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-87b88544-9397-4d02-9200-ab2347198334 tempest-SnapshotDependencyTests-639947689 None] Acquiring lock "cinder-quobyte-9dc3e6a0-b213-4185-ad6c-aa5531fff0c8" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:54:33 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-87b88544-9397-4d02-9200-ab2347198334 tempest-SnapshotDependencyTests-639947689 None] Lock "cinder-quobyte-9dc3e6a0-b213-4185-ad6c-aa5531fff0c8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:54:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-87b88544-9397-4d02-9200-ab2347198334 tempest-SnapshotDependencyTests-639947689 None] Deleting offline snapshot 9dc3e6a0-b213-4185-ad6c-aa5531fff0c8 of volume 5f946cd1-de56-450d-9c11-f43729708953 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:54:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-87b88544-9397-4d02-9200-ab2347198334 tempest-SnapshotDependencyTests-639947689 None] snapshot_file for this snap is: volume-5f946cd1-de56-450d-9c11-f43729708953.9dc3e6a0-b213-4185-ad6c-aa5531fff0c8 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:54:33 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a175bf-0dd4-4d15-a9ce-cee50247397e]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:54:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-87b88544-9397-4d02-9200-ab2347198334 tempest-SnapshotDependencyTests-639947689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953.9dc3e6a0-b213-4185-ad6c-aa5531fff0c8 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:33 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953.9dc3e6a0-b213-4185-ad6c-aa5531fff0c8 Jul 17 19:54:33 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:33 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-87b88544-9397-4d02-9200-ab2347198334 tempest-SnapshotDependencyTests-639947689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953.9dc3e6a0-b213-4185-ad6c-aa5531fff0c8" returned: 0 in 0.340s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-87b88544-9397-4d02-9200-ab2347198334 tempest-SnapshotDependencyTests-639947689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f946cd1-de56-450d-9c11-f43729708953(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:54:33 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f41872-8939-4a86-83d8-0926d793168d]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:54:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-87b88544-9397-4d02-9200-ab2347198334 tempest-SnapshotDependencyTests-639947689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:33 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953 Jul 17 19:54:33 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:34 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-87b88544-9397-4d02-9200-ab2347198334 tempest-SnapshotDependencyTests-639947689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953" returned: 0 in 0.347s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-87b88544-9397-4d02-9200-ab2347198334 tempest-SnapshotDependencyTests-639947689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953.9dc3e6a0-b213-4185-ad6c-aa5531fff0c8 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:34 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953.9dc3e6a0-b213-4185-ad6c-aa5531fff0c8 Jul 17 19:54:34 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:34 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-87b88544-9397-4d02-9200-ab2347198334 tempest-SnapshotDependencyTests-639947689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953.9dc3e6a0-b213-4185-ad6c-aa5531fff0c8" returned: 0 in 0.320s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-87b88544-9397-4d02-9200-ab2347198334 tempest-SnapshotDependencyTests-639947689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953.9dc3e6a0-b213-4185-ad6c-aa5531fff0c8 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:34 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953.9dc3e6a0-b213-4185-ad6c-aa5531fff0c8 Jul 17 19:54:34 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:34 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-87b88544-9397-4d02-9200-ab2347198334 tempest-SnapshotDependencyTests-639947689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953.9dc3e6a0-b213-4185-ad6c-aa5531fff0c8" returned: 0 in 0.239s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:34 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-87b88544-9397-4d02-9200-ab2347198334 tempest-SnapshotDependencyTests-639947689 None] Lock "cinder-quobyte-9dc3e6a0-b213-4185-ad6c-aa5531fff0c8" released by "_delete_snapshot" :: held 1.337s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:54:34 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-87b88544-9397-4d02-9200-ab2347198334 tempest-SnapshotDependencyTests-639947689 None] Lock "cinder-quobyte-5f946cd1-de56-450d-9c11-f43729708953" released by "delete_snapshot" :: held 1.360s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:54:34 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-87b88544-9397-4d02-9200-ab2347198334 tempest-SnapshotDependencyTests-639947689 None] Created reservations ['0bc2f8c3-74ee-497a-874c-875d9022c9c8', '607006b4-1652-421f-8acd-05f51d9a1c6a', '59ac56f9-d9c0-40de-9f6e-218e855f7ae6', '18799170-3e2e-43c1-8af3-66a0808bde88'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:54:34 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-87b88544-9397-4d02-9200-ab2347198334 tempest-SnapshotDependencyTests-639947689 None] Delete snapshot completed successfully. Jul 17 19:54:34 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-87b88544-9397-4d02-9200-ab2347198334 tempest-SnapshotDependencyTests-639947689 None] Lock "cinder-9dc3e6a0-b213-4185-ad6c-aa5531fff0c8-delete_snapshot" released by "delete_snapshot" :: held 1.488s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:54:35 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-29ff4a71-6955-4613-a379-102c64028965 tempest-SnapshotDependencyTests-639947689 None] Acquiring lock "cinder-5f946cd1-de56-450d-9c11-f43729708953-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:54:35 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-29ff4a71-6955-4613-a379-102c64028965 tempest-SnapshotDependencyTests-639947689 None] Lock "cinder-5f946cd1-de56-450d-9c11-f43729708953-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:54:35 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-29ff4a71-6955-4613-a379-102c64028965 tempest-SnapshotDependencyTests-639947689 None] Acquiring lock "cinder-quobyte-5f946cd1-de56-450d-9c11-f43729708953" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:54:35 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-29ff4a71-6955-4613-a379-102c64028965 tempest-SnapshotDependencyTests-639947689 None] Lock "cinder-quobyte-5f946cd1-de56-450d-9c11-f43729708953" acquired by "delete_volume" :: waited 0.015s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:54:35 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[31edd452-2986-4b9b-8490-41384a10519e]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:54:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-29ff4a71-6955-4613-a379-102c64028965 tempest-SnapshotDependencyTests-639947689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:35 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953 Jul 17 19:54:35 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:36 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-29ff4a71-6955-4613-a379-102c64028965 tempest-SnapshotDependencyTests-639947689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953" returned: 0 in 0.346s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-29ff4a71-6955-4613-a379-102c64028965 tempest-SnapshotDependencyTests-639947689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:36 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953 Jul 17 19:54:36 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:36 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-29ff4a71-6955-4613-a379-102c64028965 tempest-SnapshotDependencyTests-639947689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f946cd1-de56-450d-9c11-f43729708953" returned: 0 in 0.240s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-29ff4a71-6955-4613-a379-102c64028965 tempest-SnapshotDependencyTests-639947689 None] Lock "cinder-quobyte-5f946cd1-de56-450d-9c11-f43729708953" released by "delete_volume" :: held 0.641s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:54:36 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-29ff4a71-6955-4613-a379-102c64028965 tempest-SnapshotDependencyTests-639947689 None] Created reservations ['2f7efbb5-8c03-457e-a6ce-4c2a856c5cf1', 'eccb27cf-502d-4a48-925b-6ecf8c93dfc6', '12ea04d0-0fbc-4f98-bf45-91738fb26212', '9dc28f44-6c91-4f74-8b10-14c91c92a450'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:54:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-29ff4a71-6955-4613-a379-102c64028965 tempest-SnapshotDependencyTests-639947689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:54:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-29ff4a71-6955-4613-a379-102c64028965 tempest-SnapshotDependencyTests-639947689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:54:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-29ff4a71-6955-4613-a379-102c64028965 tempest-SnapshotDependencyTests-639947689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:54:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-29ff4a71-6955-4613-a379-102c64028965 tempest-SnapshotDependencyTests-639947689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:54:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-29ff4a71-6955-4613-a379-102c64028965 tempest-SnapshotDependencyTests-639947689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:54:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-29ff4a71-6955-4613-a379-102c64028965 tempest-SnapshotDependencyTests-639947689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:36 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:54:36 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:36 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-29ff4a71-6955-4613-a379-102c64028965 tempest-SnapshotDependencyTests-639947689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.252s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:36 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-29ff4a71-6955-4613-a379-102c64028965 tempest-SnapshotDependencyTests-639947689 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:54:36 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-29ff4a71-6955-4613-a379-102c64028965 tempest-SnapshotDependencyTests-639947689 None] Deleted volume successfully. Jul 17 19:54:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-29ff4a71-6955-4613-a379-102c64028965 tempest-SnapshotDependencyTests-639947689 None] Lock "cinder-5f946cd1-de56-450d-9c11-f43729708953-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:54:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-de49ed45-4726-4170-97cf-b72076faf2bf tempest-SnapshotDependencyTests-639947689 None] Acquiring lock "cinder-2fd230e1-8657-429d-a267-93e6db7cb7cc-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:54:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-de49ed45-4726-4170-97cf-b72076faf2bf tempest-SnapshotDependencyTests-639947689 None] Lock "cinder-2fd230e1-8657-429d-a267-93e6db7cb7cc-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:54:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-de49ed45-4726-4170-97cf-b72076faf2bf tempest-SnapshotDependencyTests-639947689 None] Acquiring lock "cinder-quobyte-2fd230e1-8657-429d-a267-93e6db7cb7cc" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:54:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-de49ed45-4726-4170-97cf-b72076faf2bf tempest-SnapshotDependencyTests-639947689 None] Lock "cinder-quobyte-2fd230e1-8657-429d-a267-93e6db7cb7cc" acquired by "delete_volume" :: waited 0.014s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:54:36 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26252b9-92ed-4888-9240-ade194a7aa6e]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:54:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-de49ed45-4726-4170-97cf-b72076faf2bf tempest-SnapshotDependencyTests-639947689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fd230e1-8657-429d-a267-93e6db7cb7cc {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:36 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fd230e1-8657-429d-a267-93e6db7cb7cc Jul 17 19:54:36 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:37 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-de49ed45-4726-4170-97cf-b72076faf2bf tempest-SnapshotDependencyTests-639947689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fd230e1-8657-429d-a267-93e6db7cb7cc" returned: 0 in 0.353s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-de49ed45-4726-4170-97cf-b72076faf2bf tempest-SnapshotDependencyTests-639947689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fd230e1-8657-429d-a267-93e6db7cb7cc {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:37 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fd230e1-8657-429d-a267-93e6db7cb7cc Jul 17 19:54:37 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:37 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-de49ed45-4726-4170-97cf-b72076faf2bf tempest-SnapshotDependencyTests-639947689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2fd230e1-8657-429d-a267-93e6db7cb7cc" returned: 0 in 0.243s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-de49ed45-4726-4170-97cf-b72076faf2bf tempest-SnapshotDependencyTests-639947689 None] Lock "cinder-quobyte-2fd230e1-8657-429d-a267-93e6db7cb7cc" released by "delete_volume" :: held 0.631s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:54:37 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-de49ed45-4726-4170-97cf-b72076faf2bf tempest-SnapshotDependencyTests-639947689 None] Created reservations ['ec6a20bd-13d1-40ce-a56f-f4d0879fd65f', '704b5fb7-137d-4c93-b78e-7ca38e71b749', 'b79a87cb-a347-4e4e-bc00-6e311db62108', 'bb1cb133-f519-434f-bfe9-93031a9840c4'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:54:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-de49ed45-4726-4170-97cf-b72076faf2bf tempest-SnapshotDependencyTests-639947689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:54:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-de49ed45-4726-4170-97cf-b72076faf2bf tempest-SnapshotDependencyTests-639947689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:54:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-de49ed45-4726-4170-97cf-b72076faf2bf tempest-SnapshotDependencyTests-639947689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:54:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-de49ed45-4726-4170-97cf-b72076faf2bf tempest-SnapshotDependencyTests-639947689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:54:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-de49ed45-4726-4170-97cf-b72076faf2bf tempest-SnapshotDependencyTests-639947689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:54:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-de49ed45-4726-4170-97cf-b72076faf2bf tempest-SnapshotDependencyTests-639947689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:37 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:54:37 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:37 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-de49ed45-4726-4170-97cf-b72076faf2bf tempest-SnapshotDependencyTests-639947689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.239s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:37 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-de49ed45-4726-4170-97cf-b72076faf2bf tempest-SnapshotDependencyTests-639947689 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:54:37 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-de49ed45-4726-4170-97cf-b72076faf2bf tempest-SnapshotDependencyTests-639947689 None] Deleted volume successfully. Jul 17 19:54:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-de49ed45-4726-4170-97cf-b72076faf2bf tempest-SnapshotDependencyTests-639947689 None] Lock "cinder-2fd230e1-8657-429d-a267-93e6db7cb7cc-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:54:47 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=29,cinder:UPDATE=30,cinder:DELETE=2,cinder:INSERT=5 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:54:47 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:UPDATE=26,cinder:SELECT=18,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Flow 'volume_create_manager' (efc6780d-4dc8-46fd-9d96-8680eea3e460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8abc269-6dcf-43bc-88b7-89dc1ff31309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8abc269-6dcf-43bc-88b7-89dc1ff31309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-709285126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56140e7c-7018-4b31-aadb-a2886a29553c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb8c854877f426fb8f1231420d1b8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:54:56Z,use_quota=True,user_id='3876d46298f4486c962117cdfa6a0e8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf4b9b3-7b88-4a02-a3cb-bf1b6132a2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf4b9b3-7b88-4a02-a3cb-bf1b6132a2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757c3d62-029b-4358-84ea-1e450b915f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757c3d62-029b-4358-84ea-1e450b915f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56140e7c-7018-4b31-aadb-a2886a29553c', 'volume_name': 'volume-56140e7c-7018-4b31-aadb-a2886a29553c', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f20335eb-0dc7-4ea7-852f-c2d3689354a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f20335eb-0dc7-4ea7-852f-c2d3689354a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3470ad04-c23b-4f71-bcdd-48557e9a52b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:56 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Volume 56140e7c-7018-4b31-aadb-a2886a29553c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56140e7c-7018-4b31-aadb-a2886a29553c', 'volume_size': 1} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-709285126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56140e7c-7018-4b31-aadb-a2886a29553c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb8c854877f426fb8f1231420d1b8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:54:56Z,use_quota=True,user_id='3876d46298f4486c962117cdfa6a0e8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Creating volume 56140e7c-7018-4b31-aadb-a2886a29553c {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:54:56 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:56 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c 1073741824 Jul 17 19:54:56 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Flow 'volume_create_manager' (77f3d675-c117-4854-897d-1267768bc19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d9114a4-d3ae-4d99-b71a-6f85fb005488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d9114a4-d3ae-4d99-b71a-6f85fb005488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-551149659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6bb8532-e5a7-441a-8cce-0609b2f09eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b2be4e9615542419539ebcaf9fb2245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:54:56Z,use_quota=True,user_id='0bbe18c147cb4209868af1ba8bd41498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (921eca8c-80c0-420a-8630-50eeec568000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (921eca8c-80c0-420a-8630-50eeec568000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaadbd45-8add-4ead-a6a9-729c0a20f6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaadbd45-8add-4ead-a6a9-729c0a20f6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6bb8532-e5a7-441a-8cce-0609b2f09eda', 'volume_name': 'volume-a6bb8532-e5a7-441a-8cce-0609b2f09eda', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6027ef3d-c58b-461a-80f4-1579ad4b556f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6027ef3d-c58b-461a-80f4-1579ad4b556f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03558a14-b6be-4a26-8307-2c31849998fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:56 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Volume a6bb8532-e5a7-441a-8cce-0609b2f09eda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6bb8532-e5a7-441a-8cce-0609b2f09eda', 'volume_size': 1} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] Flow 'volume_create_manager' (96069d2d-477b-44e1-b35a-e7f6dff70494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de859156-56f8-4b22-b918-ac8df182b083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de859156-56f8-4b22-b918-ac8df182b083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-834338311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69905842-faa7-49c0-8f87-7ac0fc7aac36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f04dc913d304e0eb50155cba185a903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:54:57Z,use_quota=True,user_id='09b44baec5c24d63afcc1e979508b594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd08c53-d5ab-46ab-9311-13f46afec135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:56 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd08c53-d5ab-46ab-9311-13f46afec135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108ac2ce-e530-4248-88c9-852f29457403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108ac2ce-e530-4248-88c9-852f29457403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69905842-faa7-49c0-8f87-7ac0fc7aac36', 'volume_name': 'volume-69905842-faa7-49c0-8f87-7ac0fc7aac36', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b15ce0-c3a8-4db8-aa78-ac11f0f8d3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b15ce0-c3a8-4db8-aa78-ac11f0f8d3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e76e770a-16f2-4059-bac9-cca34a8c5540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:56 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] Volume 69905842-faa7-49c0-8f87-7ac0fc7aac36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69905842-faa7-49c0-8f87-7ac0fc7aac36', 'volume_size': 1} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c 1073741824" returned: 0 in 0.599s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:56 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c Jul 17 19:54:56 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:54:57 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] Flow 'volume_create_manager' (e48fce27-87ad-48e8-9902-8db03d7dc398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82090200-60c1-402d-8289-fdd0c81885e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c" returned: 0 in 0.324s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.809s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-551149659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6bb8532-e5a7-441a-8cce-0609b2f09eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b2be4e9615542419539ebcaf9fb2245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:54:56Z,use_quota=True,user_id='0bbe18c147cb4209868af1ba8bd41498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Creating volume a6bb8532-e5a7-441a-8cce-0609b2f09eda {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:54:57 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a6bb8532-e5a7-441a-8cce-0609b2f09eda 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82090200-60c1-402d-8289-fdd0c81885e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1055880017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cbb9435-6069-4837-b50b-e2c0b2afeef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f04dc913d304e0eb50155cba185a903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:54:57Z,use_quota=True,user_id='09b44baec5c24d63afcc1e979508b594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2945387-4cd0-47da-9472-0f0656b82ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2945387-4cd0-47da-9472-0f0656b82ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:57 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a6bb8532-e5a7-441a-8cce-0609b2f09eda 1073741824 Jul 17 19:54:57 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84c2a5e5-f7b3-419b-9b32-42fd3fd04664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84c2a5e5-f7b3-419b-9b32-42fd3fd04664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cbb9435-6069-4837-b50b-e2c0b2afeef5', 'volume_name': 'volume-5cbb9435-6069-4837-b50b-e2c0b2afeef5', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664cd6c6-6c73-4e5e-a211-da546a41da0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664cd6c6-6c73-4e5e-a211-da546a41da0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d21b2574-69a8-40c9-951d-7cda213678eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:57 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] Volume 5cbb9435-6069-4837-b50b-e2c0b2afeef5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cbb9435-6069-4837-b50b-e2c0b2afeef5', 'volume_size': 1} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3470ad04-c23b-4f71-bcdd-48557e9a52b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56140e7c-7018-4b31-aadb-a2886a29553c', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77cab32b-4a87-4ea5-91c6-bde034bdf369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:57 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Volume volume-56140e7c-7018-4b31-aadb-a2886a29553c (56140e7c-7018-4b31-aadb-a2886a29553c): created successfully Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77cab32b-4a87-4ea5-91c6-bde034bdf369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Flow 'volume_create_manager' (efc6780d-4dc8-46fd-9d96-8680eea3e460) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:54:57 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-d64c0c6e-dc40-4c74-a963-af2bc5226124 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Created volume successfully. Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] Flow 'volume_create_manager' (c557cfeb-9275-4fb2-a0ec-d309203d523d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e607f6a-8a2a-4593-9ecd-c354724475f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e607f6a-8a2a-4593-9ecd-c354724475f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-567783368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c23bfca8-4f2e-49f4-8a82-4c13455b595c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f04dc913d304e0eb50155cba185a903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:54:57Z,use_quota=True,user_id='09b44baec5c24d63afcc1e979508b594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70265db5-a212-4d7a-93ed-6acc4846cfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70265db5-a212-4d7a-93ed-6acc4846cfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8805403-c256-4c23-ad61-38bddd05680c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8805403-c256-4c23-ad61-38bddd05680c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c23bfca8-4f2e-49f4-8a82-4c13455b595c', 'volume_name': 'volume-c23bfca8-4f2e-49f4-8a82-4c13455b595c', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e9843e-6764-497e-932e-553e9f8ee611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e9843e-6764-497e-932e-553e9f8ee611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e832f707-28e8-41da-8b17-b247b3007902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:57 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] Volume c23bfca8-4f2e-49f4-8a82-4c13455b595c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c23bfca8-4f2e-49f4-8a82-4c13455b595c', 'volume_size': 1} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:54:57 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a6bb8532-e5a7-441a-8cce-0609b2f09eda 1073741824" returned: 0 in 0.577s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a6bb8532-e5a7-441a-8cce-0609b2f09eda {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:57 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a6bb8532-e5a7-441a-8cce-0609b2f09eda Jul 17 19:54:57 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:58 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] Flow 'volume_create_manager' (22cb328c-0165-4d6f-a016-cc08f4853921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65a35f01-b5f8-495f-a28d-7a7d9b0ca6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a6bb8532-e5a7-441a-8cce-0609b2f09eda" returned: 0 in 0.436s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.449s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-834338311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69905842-faa7-49c0-8f87-7ac0fc7aac36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f04dc913d304e0eb50155cba185a903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:54:57Z,use_quota=True,user_id='09b44baec5c24d63afcc1e979508b594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] Creating volume 69905842-faa7-49c0-8f87-7ac0fc7aac36 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:54:58 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69905842-faa7-49c0-8f87-7ac0fc7aac36 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65a35f01-b5f8-495f-a28d-7a7d9b0ca6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2053616551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26bab4e0-538c-4d29-83e6-4cad92f5978b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f04dc913d304e0eb50155cba185a903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:54:58Z,use_quota=True,user_id='09b44baec5c24d63afcc1e979508b594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:58 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69905842-faa7-49c0-8f87-7ac0fc7aac36 1073741824 Jul 17 19:54:58 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b50df53-7a43-409f-8d10-d13e8b31f501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b50df53-7a43-409f-8d10-d13e8b31f501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02657b4c-bc03-477e-be86-32cd1b9929ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02657b4c-bc03-477e-be86-32cd1b9929ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26bab4e0-538c-4d29-83e6-4cad92f5978b', 'volume_name': 'volume-26bab4e0-538c-4d29-83e6-4cad92f5978b', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df903968-58bf-4a03-85a4-f0010dba66ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df903968-58bf-4a03-85a4-f0010dba66ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92f5798-b36b-4d3f-b564-812e24e5d44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:58 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] Volume 26bab4e0-538c-4d29-83e6-4cad92f5978b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26bab4e0-538c-4d29-83e6-4cad92f5978b', 'volume_size': 1} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03558a14-b6be-4a26-8307-2c31849998fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6bb8532-e5a7-441a-8cce-0609b2f09eda', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ea9658-8802-48b3-969d-ec6f4e6592f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-da080ccd-bc0c-4eaa-a323-3b9845e9c1bf tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:54:58 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Volume volume-a6bb8532-e5a7-441a-8cce-0609b2f09eda (a6bb8532-e5a7-441a-8cce-0609b2f09eda): created successfully Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ea9658-8802-48b3-969d-ec6f4e6592f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Flow 'volume_create_manager' (77f3d675-c117-4854-897d-1267768bc19e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:54:58 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-2b428253-d9c2-4461-a362-e8e40f9eff0c tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Created volume successfully. Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] Flow 'volume_create_manager' (92a9e666-77ad-42c1-a4d8-c5ea155f5855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2565de48-b3b6-4af6-a973-ad555660f5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2565de48-b3b6-4af6-a973-ad555660f5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-277738280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce201fe-7407-4843-91de-12edb8457a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f04dc913d304e0eb50155cba185a903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:54:59Z,use_quota=True,user_id='09b44baec5c24d63afcc1e979508b594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff691e2-5052-4d14-832f-57688b04da14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff691e2-5052-4d14-832f-57688b04da14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3008db9-3dc0-4b3a-8f7f-272ff211416c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3008db9-3dc0-4b3a-8f7f-272ff211416c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ce201fe-7407-4843-91de-12edb8457a5c', 'volume_name': 'volume-8ce201fe-7407-4843-91de-12edb8457a5c', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46bfb17f-b578-49d9-a596-d4c302b184af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46bfb17f-b578-49d9-a596-d4c302b184af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (050f45da-2e6a-4701-a965-e9cd217d1aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:58 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] Volume 8ce201fe-7407-4843-91de-12edb8457a5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ce201fe-7407-4843-91de-12edb8457a5c', 'volume_size': 1} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:54:58 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69905842-faa7-49c0-8f87-7ac0fc7aac36 1073741824" returned: 0 in 0.519s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69905842-faa7-49c0-8f87-7ac0fc7aac36 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:58 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69905842-faa7-49c0-8f87-7ac0fc7aac36 Jul 17 19:54:58 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:59 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69905842-faa7-49c0-8f87-7ac0fc7aac36" returned: 0 in 0.249s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.807s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1055880017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cbb9435-6069-4837-b50b-e2c0b2afeef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f04dc913d304e0eb50155cba185a903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:54:57Z,use_quota=True,user_id='09b44baec5c24d63afcc1e979508b594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] Creating volume 5cbb9435-6069-4837-b50b-e2c0b2afeef5 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:54:59 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cbb9435-6069-4837-b50b-e2c0b2afeef5 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e76e770a-16f2-4059-bac9-cca34a8c5540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69905842-faa7-49c0-8f87-7ac0fc7aac36', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87981322-7817-4e4d-9b53-fe9cc5815b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:59 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cbb9435-6069-4837-b50b-e2c0b2afeef5 1073741824 Jul 17 19:54:59 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:59 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] Volume volume-69905842-faa7-49c0-8f87-7ac0fc7aac36 (69905842-faa7-49c0-8f87-7ac0fc7aac36): created successfully Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87981322-7817-4e4d-9b53-fe9cc5815b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] Flow 'volume_create_manager' (96069d2d-477b-44e1-b35a-e7f6dff70494) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:54:59 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-ac2fb16c-420e-46b4-bfd2-edc889860b4d tempest-CreateVolumesFromImageTest-672512528 None] Created volume successfully. Jul 17 19:54:59 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cbb9435-6069-4837-b50b-e2c0b2afeef5 1073741824" returned: 0 in 0.503s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cbb9435-6069-4837-b50b-e2c0b2afeef5 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:59 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cbb9435-6069-4837-b50b-e2c0b2afeef5 Jul 17 19:54:59 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:54:59 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cbb9435-6069-4837-b50b-e2c0b2afeef5" returned: 0 in 0.291s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.230s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-567783368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c23bfca8-4f2e-49f4-8a82-4c13455b595c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f04dc913d304e0eb50155cba185a903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:54:57Z,use_quota=True,user_id='09b44baec5c24d63afcc1e979508b594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] Creating volume c23bfca8-4f2e-49f4-8a82-4c13455b595c {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:54:59 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c23bfca8-4f2e-49f4-8a82-4c13455b595c 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Flow 'volume_create_manager' (d520d91f-2173-43d0-9362-12c29832a26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:54:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2549bbb2-c13d-4ecd-83e5-9d3f843b3159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:54:59 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c23bfca8-4f2e-49f4-8a82-4c13455b595c 1073741824 Jul 17 19:54:59 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d21b2574-69a8-40c9-951d-7cda213678eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cbb9435-6069-4837-b50b-e2c0b2afeef5', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9426c573-4e3c-4efc-a921-215d8e44177d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2549bbb2-c13d-4ecd-83e5-9d3f843b3159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-721276611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e1558d-0d76-4d26-93cb-e2faf530ea5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b2be4e9615542419539ebcaf9fb2245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:00Z,use_quota=True,user_id='0bbe18c147cb4209868af1ba8bd41498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9adbca54-4061-4e89-8ffb-e065ab396691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9adbca54-4061-4e89-8ffb-e065ab396691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1bb22a-a4a4-43d6-bdc6-578d16108ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1bb22a-a4a4-43d6-bdc6-578d16108ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50e1558d-0d76-4d26-93cb-e2faf530ea5a', 'volume_name': 'volume-50e1558d-0d76-4d26-93cb-e2faf530ea5a', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f06778b7-723e-414f-bf23-e47e8479d47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f06778b7-723e-414f-bf23-e47e8479d47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1386e4d4-7782-4ddf-a7b9-43137c0b6a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:00 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Volume 50e1558d-0d76-4d26-93cb-e2faf530ea5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50e1558d-0d76-4d26-93cb-e2faf530ea5a', 'volume_size': 1} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:00 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] Volume volume-5cbb9435-6069-4837-b50b-e2c0b2afeef5 (5cbb9435-6069-4837-b50b-e2c0b2afeef5): created successfully Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9426c573-4e3c-4efc-a921-215d8e44177d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] Flow 'volume_create_manager' (e48fce27-87ad-48e8-9902-8db03d7dc398) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:00 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-0037012d-c28c-4ecb-aa07-c18aaeba06cf tempest-CreateVolumesFromImageTest-672512528 None] Created volume successfully. Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Flow 'volume_create_manager' (ab63c44f-e039-45b1-ae5a-e7b2e31d357b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c25c647-304b-40c1-82c8-f1055908d9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c25c647-304b-40c1-82c8-f1055908d9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2565bf6d-0e97-4862-a832-fa5ae58e3f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9645f1410e194dc29b3dfb68231c2e39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:00Z,use_quota=True,user_id='407957ee93a84650aa441180dd713952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98e62150-c297-4120-97f9-3bf4b1ad388f),volume_type_id=98e62150-c297-4120-97f9-3bf4b1ad388f)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5549e117-3cc3-448e-821b-3c973b099997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5549e117-3cc3-448e-821b-3c973b099997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:00 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b2781ea-7017-4fda-a2cb-e221c5f75a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.image.glance [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Creating Keystone auth plugin from conf {{(pid=87726) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c23bfca8-4f2e-49f4-8a82-4c13455b595c 1073741824" returned: 0 in 0.641s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Flow 'volume_create_manager' (7e29da21-58b1-4d89-82e3-096146d57f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f60e161-94a4-4261-985d-0687b357ddca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f60e161-94a4-4261-985d-0687b357ddca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1376920195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12801501-f7dd-4139-9c42-8c343098f28f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b2be4e9615542419539ebcaf9fb2245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:00Z,use_quota=True,user_id='0bbe18c147cb4209868af1ba8bd41498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (299ded64-2cd2-414e-9493-6b219ce61bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (299ded64-2cd2-414e-9493-6b219ce61bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (032a810b-c7bc-4610-a082-598451cc1a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (032a810b-c7bc-4610-a082-598451cc1a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12801501-f7dd-4139-9c42-8c343098f28f', 'volume_name': 'volume-12801501-f7dd-4139-9c42-8c343098f28f', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ca5d7d-e5d2-4ad7-b8bc-2602802870ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ca5d7d-e5d2-4ad7-b8bc-2602802870ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d009f4d5-0d6a-4567-acd6-ce02f661a85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:00 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Volume 12801501-f7dd-4139-9c42-8c343098f28f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12801501-f7dd-4139-9c42-8c343098f28f', 'volume_size': 1} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c23bfca8-4f2e-49f4-8a82-4c13455b595c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:00 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c23bfca8-4f2e-49f4-8a82-4c13455b595c Jul 17 19:55:00 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:00 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Flow 'volume_create_manager' (e7691490-6956-4471-b0f7-4dc547198f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6cf215-5aca-43d5-978f-316b4f9093d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6cf215-5aca-43d5-978f-316b4f9093d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-985068177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f74b122c-b73d-4da3-9ce1-6dbf67cefa56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b2be4e9615542419539ebcaf9fb2245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:01Z,use_quota=True,user_id='0bbe18c147cb4209868af1ba8bd41498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87eb1706-3fb3-4364-9ef0-2753ff840137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87eb1706-3fb3-4364-9ef0-2753ff840137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e142a41-1a35-499d-974b-1ba57f500df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e142a41-1a35-499d-974b-1ba57f500df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f74b122c-b73d-4da3-9ce1-6dbf67cefa56', 'volume_name': 'volume-f74b122c-b73d-4da3-9ce1-6dbf67cefa56', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcab9bbc-b94e-469b-a1bf-5336568dd4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcab9bbc-b94e-469b-a1bf-5336568dd4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6ede152-441f-405a-a1fb-7b02d766cbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:01 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Volume f74b122c-b73d-4da3-9ce1-6dbf67cefa56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f74b122c-b73d-4da3-9ce1-6dbf67cefa56', 'volume_size': 1} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b2781ea-7017-4fda-a2cb-e221c5f75a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2565bf6d-0e97-4862-a832-fa5ae58e3f90', 'volume_name': 'volume-2565bf6d-0e97-4862-a832-fa5ae58e3f90', 'volume_size': 1, 'image_id': 'c35edaca-b68f-4802-afe5-5e48434ee2e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c35edaca-b68f-4802-afe5-5e48434ee2e6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a7f08cf0a57df4cccfef6682332e39d1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9645f1410e194dc29b3dfb68231c2e39', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f806e187642c1ebc8f616095c8b203ce593cdb34492e683157be4fe226250bf8ef1d23c20bd69ada99fe985655104021afb52c07ca28af77d7a865bcd3838b56', 'id': 'c35edaca-b68f-4802-afe5-5e48434ee2e6', 'created_at': datetime.datetime(2026, 7, 17, 17, 54, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 17, 54, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c35edaca-b68f-4802-afe5-5e48434ee2e6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee1f24d-eb3f-4f9d-b8e1-d23eaf397b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee1f24d-eb3f-4f9d-b8e1-d23eaf397b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f956bda8-6cc9-4fef-a498-8c4393c0b7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:01 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Volume 2565bf6d-0e97-4862-a832-fa5ae58e3f90: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2565bf6d-0e97-4862-a832-fa5ae58e3f90', 'volume_size': 1, 'image_id': 'c35edaca-b68f-4802-afe5-5e48434ee2e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c35edaca-b68f-4802-afe5-5e48434ee2e6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a7f08cf0a57df4cccfef6682332e39d1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9645f1410e194dc29b3dfb68231c2e39', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f806e187642c1ebc8f616095c8b203ce593cdb34492e683157be4fe226250bf8ef1d23c20bd69ada99fe985655104021afb52c07ca28af77d7a865bcd3838b56', 'id': 'c35edaca-b68f-4802-afe5-5e48434ee2e6', 'created_at': datetime.datetime(2026, 7, 17, 17, 54, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 17, 54, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c35edaca-b68f-4802-afe5-5e48434ee2e6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Trying to clone 2565bf6d-0e97-4862-a832-fa5ae58e3f90 from image c35edaca-b68f-4802-afe5-5e48434ee2e6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c35edaca-b68f-4802-afe5-5e48434ee2e6', 'metadata': {}}]). {{(pid=87726) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 19:55:01 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c23bfca8-4f2e-49f4-8a82-4c13455b595c" returned: 0 in 0.390s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.864s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2053616551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26bab4e0-538c-4d29-83e6-4cad92f5978b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f04dc913d304e0eb50155cba185a903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:54:58Z,use_quota=True,user_id='09b44baec5c24d63afcc1e979508b594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] Creating volume 26bab4e0-538c-4d29-83e6-4cad92f5978b {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:55:01 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-26bab4e0-538c-4d29-83e6-4cad92f5978b 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:01 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-26bab4e0-538c-4d29-83e6-4cad92f5978b 1073741824 Jul 17 19:55:01 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e832f707-28e8-41da-8b17-b247b3007902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c23bfca8-4f2e-49f4-8a82-4c13455b595c', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d6e0e5-584f-4c0b-8ae4-ece8095120af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:01 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] Volume volume-c23bfca8-4f2e-49f4-8a82-4c13455b595c (c23bfca8-4f2e-49f4-8a82-4c13455b595c): created successfully Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d6e0e5-584f-4c0b-8ae4-ece8095120af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] Flow 'volume_create_manager' (c557cfeb-9275-4fb2-a0ec-d309203d523d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c35edaca-b68f-4802-afe5-5e48434ee2e6_n2uivm2ydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87726) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 19:55:01 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Image download 0.00 MB at 0.00 MB/s Jul 17 19:55:01 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-ad2106d6-aeea-4b9a-ad4e-8a686132be75 tempest-CreateVolumesFromImageTest-672512528 None] Created volume successfully. Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[822a4bcc-bf20-4610-ab65-7196f486a37a]: (4, 'raw') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c35edaca-b68f-4802-afe5-5e48434ee2e6_n2uivm2ydevstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:01 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c35edaca-b68f-4802-afe5-5e48434ee2e6_n2uivm2ydevstack@QuobyteHD Jul 17 19:55:01 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Flow 'volume_create_manager' (5ef319ff-37b1-41c2-99ff-bc4812773d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70e40765-0146-4679-bf37-b38d4bbebad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70e40765-0146-4679-bf37-b38d4bbebad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1660481866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c633763b-804b-4406-af64-185bf2a938f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b2be4e9615542419539ebcaf9fb2245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:01Z,use_quota=True,user_id='0bbe18c147cb4209868af1ba8bd41498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c748205-10db-473f-9b21-7df5798dc569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c748205-10db-473f-9b21-7df5798dc569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d24bc7-6d24-4e56-a455-bbc8ca6a78c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d24bc7-6d24-4e56-a455-bbc8ca6a78c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c633763b-804b-4406-af64-185bf2a938f3', 'volume_name': 'volume-c633763b-804b-4406-af64-185bf2a938f3', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fc125ac-3918-486f-9ac8-317276beaf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fc125ac-3918-486f-9ac8-317276beaf38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9c3277d-ad6a-472d-9ab0-9acac58e388e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:01 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Volume c633763b-804b-4406-af64-185bf2a938f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c633763b-804b-4406-af64-185bf2a938f3', 'volume_size': 1} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:01 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c35edaca-b68f-4802-afe5-5e48434ee2e6_n2uivm2ydevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c35edaca-b68f-4802-afe5-5e48434ee2e6_n2uivm2ydevstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:01 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-26bab4e0-538c-4d29-83e6-4cad92f5978b 1073741824" returned: 0 in 0.603s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Flow 'volume_create_manager' (1e7f6fb0-f7f6-40c0-93f1-ffa8d3b930e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad8d1063-1e06-425b-8993-f6198b24f88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-26bab4e0-538c-4d29-83e6-4cad92f5978b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:01 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c35edaca-b68f-4802-afe5-5e48434ee2e6_n2uivm2ydevstack@QuobyteHD Jul 17 19:55:01 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad8d1063-1e06-425b-8993-f6198b24f88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-52679469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ea15c9-1d9f-473c-a733-9442951dc666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b2be4e9615542419539ebcaf9fb2245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:02Z,use_quota=True,user_id='0bbe18c147cb4209868af1ba8bd41498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:01 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-26bab4e0-538c-4d29-83e6-4cad92f5978b Jul 17 19:55:01 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1edeb555-eb32-49d5-819b-4d25501b3cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1edeb555-eb32-49d5-819b-4d25501b3cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f37b10f-f13a-4104-9de4-3639ff22968c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f37b10f-f13a-4104-9de4-3639ff22968c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93ea15c9-1d9f-473c-a733-9442951dc666', 'volume_name': 'volume-93ea15c9-1d9f-473c-a733-9442951dc666', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b85329de-7dd8-456c-bcf9-5a10773d37a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b85329de-7dd8-456c-bcf9-5a10773d37a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bde2b32-25e2-4b25-89ea-e1d09a13355b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:01 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Volume 93ea15c9-1d9f-473c-a733-9442951dc666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93ea15c9-1d9f-473c-a733-9442951dc666', 'volume_size': 1} Jul 17 19:55:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:02 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c35edaca-b68f-4802-afe5-5e48434ee2e6_n2uivm2ydevstack@QuobyteHD" returned: 1 in 0.331s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c35edaca-b68f-4802-afe5-5e48434ee2e6_n2uivm2ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 19:55:02 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Temporary image c35edaca-b68f-4802-afe5-5e48434ee2e6 is fetched for user 407957ee93a84650aa441180dd713952. {{(pid=87726) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 19:55:02 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-26bab4e0-538c-4d29-83e6-4cad92f5978b" returned: 0 in 0.258s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:02 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:55:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-da080ccd-bc0c-4eaa-a323-3b9845e9c1bf tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.785s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:02 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-da080ccd-bc0c-4eaa-a323-3b9845e9c1bf tempest-CreateVolumesFromSnapshotTest-1952803094 None] Creating offline snapshot 152b5808-8ff0-4553-98df-81c2b026b667 of volume 56140e7c-7018-4b31-aadb-a2886a29553c {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:55:02 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92f5798-b36b-4d3f-b564-812e24e5d44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26bab4e0-538c-4d29-83e6-4cad92f5978b', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:02 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66bb10aa-3d52-4df2-9cde-73a02e405f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:02 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d441808-2176-444f-b2ac-2264a3f27872]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-da080ccd-bc0c-4eaa-a323-3b9845e9c1bf tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:02 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] Volume volume-26bab4e0-538c-4d29-83e6-4cad92f5978b (26bab4e0-538c-4d29-83e6-4cad92f5978b): created successfully Jul 17 19:55:02 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66bb10aa-3d52-4df2-9cde-73a02e405f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:02 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] Flow 'volume_create_manager' (22cb328c-0165-4d6f-a016-cc08f4853921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:02 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6cc0d8-e01b-4db6-b01f-6a0ba07454e1]: (4, 'raw') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c35edaca-b68f-4802-afe5-5e48434ee2e6_n2uivm2ydevstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:02 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-c0015a4b-a29a-44af-b81d-06f3cafbd28a tempest-CreateVolumesFromImageTest-672512528 None] Created volume successfully. Jul 17 19:55:02 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c Jul 17 19:55:02 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:02 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c35edaca-b68f-4802-afe5-5e48434ee2e6_n2uivm2ydevstack@QuobyteHD Jul 17 19:55:02 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:02 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-da080ccd-bc0c-4eaa-a323-3b9845e9c1bf tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c" returned: 0 in 0.404s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-da080ccd-bc0c-4eaa-a323-3b9845e9c1bf tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c.152b5808-8ff0-4553-98df-81c2b026b667 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:02 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c35edaca-b68f-4802-afe5-5e48434ee2e6_n2uivm2ydevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c35edaca-b68f-4802-afe5-5e48434ee2e6_n2uivm2ydevstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:02 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c.152b5808-8ff0-4553-98df-81c2b026b667 1G Jul 17 19:55:02 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:02 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c35edaca-b68f-4802-afe5-5e48434ee2e6_n2uivm2ydevstack@QuobyteHD Jul 17 19:55:02 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:02 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c35edaca-b68f-4802-afe5-5e48434ee2e6_n2uivm2ydevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c35edaca-b68f-4802-afe5-5e48434ee2e6_n2uivm2ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 19:55:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:03 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-da080ccd-bc0c-4eaa-a323-3b9845e9c1bf tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c.152b5808-8ff0-4553-98df-81c2b026b667 1G" returned: 0 in 0.415s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-da080ccd-bc0c-4eaa-a323-3b9845e9c1bf tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56140e7c-7018-4b31-aadb-a2886a29553c -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c.152b5808-8ff0-4553-98df-81c2b026b667 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:03 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56140e7c-7018-4b31-aadb-a2886a29553c -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c.152b5808-8ff0-4553-98df-81c2b026b667 Jul 17 19:55:03 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:03 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-da080ccd-bc0c-4eaa-a323-3b9845e9c1bf tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56140e7c-7018-4b31-aadb-a2886a29553c -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c.152b5808-8ff0-4553-98df-81c2b026b667" returned: 0 in 0.294s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:03 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-da080ccd-bc0c-4eaa-a323-3b9845e9c1bf tempest-CreateVolumesFromSnapshotTest-1952803094 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c.152b5808-8ff0-4553-98df-81c2b026b667 is being set with open permissions: ugo+rw Jul 17 19:55:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-da080ccd-bc0c-4eaa-a323-3b9845e9c1bf tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c.152b5808-8ff0-4553-98df-81c2b026b667 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:03 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c.152b5808-8ff0-4553-98df-81c2b026b667 Jul 17 19:55:03 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:03 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-da080ccd-bc0c-4eaa-a323-3b9845e9c1bf tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c.152b5808-8ff0-4553-98df-81c2b026b667" returned: 0 in 0.241s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-da080ccd-bc0c-4eaa-a323-3b9845e9c1bf tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:03 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c.info Jul 17 19:55:03 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:03 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-da080ccd-bc0c-4eaa-a323-3b9845e9c1bf tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c.info" returned: 0 in 0.247s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:03 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-da080ccd-bc0c-4eaa-a323-3b9845e9c1bf tempest-CreateVolumesFromSnapshotTest-1952803094 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c.info is being set with open permissions: ugo+rw Jul 17 19:55:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-da080ccd-bc0c-4eaa-a323-3b9845e9c1bf tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:03 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c.info Jul 17 19:55:03 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:04 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-da080ccd-bc0c-4eaa-a323-3b9845e9c1bf tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c.info" returned: 0 in 0.245s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-da080ccd-bc0c-4eaa-a323-3b9845e9c1bf tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.935s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.381s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-277738280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce201fe-7407-4843-91de-12edb8457a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f04dc913d304e0eb50155cba185a903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:54:59Z,use_quota=True,user_id='09b44baec5c24d63afcc1e979508b594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] Creating volume 8ce201fe-7407-4843-91de-12edb8457a5c {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:55:04 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8ce201fe-7407-4843-91de-12edb8457a5c 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:04 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8ce201fe-7407-4843-91de-12edb8457a5c 1073741824 Jul 17 19:55:04 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:04 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-da080ccd-bc0c-4eaa-a323-3b9845e9c1bf tempest-CreateVolumesFromSnapshotTest-1952803094 None] Create snapshot completed successfully Jul 17 19:55:04 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8ce201fe-7407-4843-91de-12edb8457a5c 1073741824" returned: 0 in 0.414s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8ce201fe-7407-4843-91de-12edb8457a5c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:04 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8ce201fe-7407-4843-91de-12edb8457a5c Jul 17 19:55:04 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:04 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8ce201fe-7407-4843-91de-12edb8457a5c" returned: 0 in 0.249s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.733s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-721276611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e1558d-0d76-4d26-93cb-e2faf530ea5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b2be4e9615542419539ebcaf9fb2245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:00Z,use_quota=True,user_id='0bbe18c147cb4209868af1ba8bd41498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Creating volume 50e1558d-0d76-4d26-93cb-e2faf530ea5a {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:55:04 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-50e1558d-0d76-4d26-93cb-e2faf530ea5a 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (050f45da-2e6a-4701-a965-e9cd217d1aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce201fe-7407-4843-91de-12edb8457a5c', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:04 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-50e1558d-0d76-4d26-93cb-e2faf530ea5a 1073741824 Jul 17 19:55:04 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b20f43e8-f59a-4fbc-a633-c4f28da0e041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:04 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] Volume volume-8ce201fe-7407-4843-91de-12edb8457a5c (8ce201fe-7407-4843-91de-12edb8457a5c): created successfully Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b20f43e8-f59a-4fbc-a633-c4f28da0e041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:04 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] Flow 'volume_create_manager' (92a9e666-77ad-42c1-a4d8-c5ea155f5855) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:04 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e5f6f647-00ac-40e0-af9f-d65bc96225ab tempest-CreateVolumesFromImageTest-672512528 None] Created volume successfully. Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Flow 'volume_create_manager' (7c24b17f-5d3d-461f-bb35-51faa0ed8270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8b82211-b616-48d7-8918-41314df379ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8b82211-b616-48d7-8918-41314df379ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2090082462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00954b0e-af6a-4907-81a2-443a796cec13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb8c854877f426fb8f1231420d1b8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:05Z,use_quota=True,user_id='3876d46298f4486c962117cdfa6a0e8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba28993e-6e50-4332-8de4-6a2da824bb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba28993e-6e50-4332-8de4-6a2da824bb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f62622-1c99-49b8-953f-65d05adf68f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f62622-1c99-49b8-953f-65d05adf68f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00954b0e-af6a-4907-81a2-443a796cec13', 'volume_name': 'volume-00954b0e-af6a-4907-81a2-443a796cec13', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e736287-53cb-4a40-b32c-3469cc0aa366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e736287-53cb-4a40-b32c-3469cc0aa366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ab245a-fcd8-4030-9685-f192900f6cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:05 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Volume 00954b0e-af6a-4907-81a2-443a796cec13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00954b0e-af6a-4907-81a2-443a796cec13', 'volume_size': 1} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:05 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-50e1558d-0d76-4d26-93cb-e2faf530ea5a 1073741824" returned: 0 in 0.486s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-50e1558d-0d76-4d26-93cb-e2faf530ea5a {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:05 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-50e1558d-0d76-4d26-93cb-e2faf530ea5a Jul 17 19:55:05 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Flow 'volume_create_manager' (974815c7-7836-49e9-83f6-d3fb8ff489de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b6f2ee4-11bf-4d82-a33b-ab95a483e2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b6f2ee4-11bf-4d82-a33b-ab95a483e2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1161228432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2894991-2cbc-4c8e-9843-2c1c38b0d1b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb8c854877f426fb8f1231420d1b8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:05Z,use_quota=True,user_id='3876d46298f4486c962117cdfa6a0e8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3385ef-db04-4b61-8592-d25681e1b905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3385ef-db04-4b61-8592-d25681e1b905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd3c67d9-3b41-4136-b2ff-b96ef3aa9911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd3c67d9-3b41-4136-b2ff-b96ef3aa9911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2894991-2cbc-4c8e-9843-2c1c38b0d1b5', 'volume_name': 'volume-d2894991-2cbc-4c8e-9843-2c1c38b0d1b5', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5235e8cc-b7c2-47ca-9a03-e4b349717f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5235e8cc-b7c2-47ca-9a03-e4b349717f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc4f2d3-d177-41c0-b455-af8d41d8d114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:05 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Volume d2894991-2cbc-4c8e-9843-2c1c38b0d1b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2894991-2cbc-4c8e-9843-2c1c38b0d1b5', 'volume_size': 1} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:05 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-08f7cbbe-f75c-4aa8-91ab-324fe4c7c69c tempest-CreateVolumesFromImageTest-672512528 None] Acquiring lock "cinder-8ce201fe-7407-4843-91de-12edb8457a5c-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-50e1558d-0d76-4d26-93cb-e2faf530ea5a" returned: 0 in 0.316s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.925s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1376920195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12801501-f7dd-4139-9c42-8c343098f28f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b2be4e9615542419539ebcaf9fb2245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:00Z,use_quota=True,user_id='0bbe18c147cb4209868af1ba8bd41498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Creating volume 12801501-f7dd-4139-9c42-8c343098f28f {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:55:05 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-12801501-f7dd-4139-9c42-8c343098f28f 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1386e4d4-7782-4ddf-a7b9-43137c0b6a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50e1558d-0d76-4d26-93cb-e2faf530ea5a', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa3aa92-9d55-4dd4-a35b-ca85888d1c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-08f7cbbe-f75c-4aa8-91ab-324fe4c7c69c tempest-CreateVolumesFromImageTest-672512528 None] Lock "cinder-8ce201fe-7407-4843-91de-12edb8457a5c-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:05 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-12801501-f7dd-4139-9c42-8c343098f28f 1073741824 Jul 17 19:55:05 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:05 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Volume volume-50e1558d-0d76-4d26-93cb-e2faf530ea5a (50e1558d-0d76-4d26-93cb-e2faf530ea5a): created successfully Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa3aa92-9d55-4dd4-a35b-ca85888d1c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Flow 'volume_create_manager' (d520d91f-2173-43d0-9362-12c29832a26e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:05 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-eac514c5-e173-4eb7-baf4-386af95e9b3a tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Created volume successfully. Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-08f7cbbe-f75c-4aa8-91ab-324fe4c7c69c tempest-CreateVolumesFromImageTest-672512528 None] Acquiring lock "cinder-quobyte-8ce201fe-7407-4843-91de-12edb8457a5c" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-08f7cbbe-f75c-4aa8-91ab-324fe4c7c69c tempest-CreateVolumesFromImageTest-672512528 None] Lock "cinder-quobyte-8ce201fe-7407-4843-91de-12edb8457a5c" acquired by "delete_volume" :: waited 0.022s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf0e114-2d17-4f1c-8318-078d48296d90]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-08f7cbbe-f75c-4aa8-91ab-324fe4c7c69c tempest-CreateVolumesFromImageTest-672512528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8ce201fe-7407-4843-91de-12edb8457a5c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:06 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8ce201fe-7407-4843-91de-12edb8457a5c Jul 17 19:55:06 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] Flow 'volume_create_manager' (4165ad9e-7e51-441a-9135-05332706eb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd0bb72-0010-46e7-95d3-71ee2bfbf436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd0bb72-0010-46e7-95d3-71ee2bfbf436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-550035804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=259a4b3f-4159-4190-b29c-025e657770b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb8c854877f426fb8f1231420d1b8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:06Z,use_quota=True,user_id='3876d46298f4486c962117cdfa6a0e8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af2c4d70-11aa-43b4-8775-299fa5d18fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af2c4d70-11aa-43b4-8775-299fa5d18fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d92aaa4-da96-469e-a8ac-83de11392986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d92aaa4-da96-469e-a8ac-83de11392986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '259a4b3f-4159-4190-b29c-025e657770b2', 'volume_name': 'volume-259a4b3f-4159-4190-b29c-025e657770b2', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b97a7853-7bb8-47f3-84e0-6dc23014bdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b97a7853-7bb8-47f3-84e0-6dc23014bdb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd1d8e9-dab4-4c4f-ac85-d409f205dca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:06 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] Volume 259a4b3f-4159-4190-b29c-025e657770b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-259a4b3f-4159-4190-b29c-025e657770b2', 'volume_size': 1} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:06 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-12801501-f7dd-4139-9c42-8c343098f28f 1073741824" returned: 0 in 0.588s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-12801501-f7dd-4139-9c42-8c343098f28f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:06 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-08f7cbbe-f75c-4aa8-91ab-324fe4c7c69c tempest-CreateVolumesFromImageTest-672512528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8ce201fe-7407-4843-91de-12edb8457a5c" returned: 0 in 0.493s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-08f7cbbe-f75c-4aa8-91ab-324fe4c7c69c tempest-CreateVolumesFromImageTest-672512528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8ce201fe-7407-4843-91de-12edb8457a5c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:06 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-12801501-f7dd-4139-9c42-8c343098f28f Jul 17 19:55:06 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:06 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8ce201fe-7407-4843-91de-12edb8457a5c Jul 17 19:55:06 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:55:06 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Flow 'volume_create_manager' (a8def097-104d-43ba-a59f-55514bbf5d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39c91e3a-70f3-4b08-bff0-f4369a4885d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-12801501-f7dd-4139-9c42-8c343098f28f" returned: 0 in 0.295s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.530s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-985068177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f74b122c-b73d-4da3-9ce1-6dbf67cefa56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b2be4e9615542419539ebcaf9fb2245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:01Z,use_quota=True,user_id='0bbe18c147cb4209868af1ba8bd41498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Creating volume f74b122c-b73d-4da3-9ce1-6dbf67cefa56 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:55:06 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f74b122c-b73d-4da3-9ce1-6dbf67cefa56 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39c91e3a-70f3-4b08-bff0-f4369a4885d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2044426916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ab168a-2ac4-4899-b76b-c0f260c08535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb8c854877f426fb8f1231420d1b8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:06Z,use_quota=True,user_id='3876d46298f4486c962117cdfa6a0e8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3898640c-ba6f-4063-9d2d-3156014403bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:06 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3898640c-ba6f-4063-9d2d-3156014403bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:06 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f74b122c-b73d-4da3-9ce1-6dbf67cefa56 1073741824 Jul 17 19:55:06 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aca4f57-3113-46e7-aff3-1d6908a0d661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aca4f57-3113-46e7-aff3-1d6908a0d661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75ab168a-2ac4-4899-b76b-c0f260c08535', 'volume_name': 'volume-75ab168a-2ac4-4899-b76b-c0f260c08535', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4330aaf1-1093-4a9d-8e1c-38cce5e05f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4330aaf1-1093-4a9d-8e1c-38cce5e05f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39dacc8-15c8-4b2b-b4e1-4236ea9a576d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:06 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Volume 75ab168a-2ac4-4899-b76b-c0f260c08535: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75ab168a-2ac4-4899-b76b-c0f260c08535', 'volume_size': 1} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-08f7cbbe-f75c-4aa8-91ab-324fe4c7c69c tempest-CreateVolumesFromImageTest-672512528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8ce201fe-7407-4843-91de-12edb8457a5c" returned: 0 in 0.375s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d009f4d5-0d6a-4567-acd6-ce02f661a85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12801501-f7dd-4139-9c42-8c343098f28f', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da8f1f3-5532-4537-8f2d-43674fb8150d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-08f7cbbe-f75c-4aa8-91ab-324fe4c7c69c tempest-CreateVolumesFromImageTest-672512528 None] Lock "cinder-quobyte-8ce201fe-7407-4843-91de-12edb8457a5c" released by "delete_volume" :: held 0.958s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:06 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Volume volume-12801501-f7dd-4139-9c42-8c343098f28f (12801501-f7dd-4139-9c42-8c343098f28f): created successfully Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da8f1f3-5532-4537-8f2d-43674fb8150d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Flow 'volume_create_manager' (7e29da21-58b1-4d89-82e3-096146d57f00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:06 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-5ebf883c-3d51-4de7-becf-48e440918141 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Created volume successfully. Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-08f7cbbe-f75c-4aa8-91ab-324fe4c7c69c tempest-CreateVolumesFromImageTest-672512528 None] Created reservations ['022cfe22-9156-4fcf-8bc1-fd4eff8302b0', '61e77dca-5a7e-41c1-a46d-f8f0bf20b4ef', '2e6c5516-2cb6-46b2-b028-121e5b7ec24f', 'a307014a-27dd-44b6-898c-7e893d2e0afb'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-08f7cbbe-f75c-4aa8-91ab-324fe4c7c69c tempest-CreateVolumesFromImageTest-672512528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-08f7cbbe-f75c-4aa8-91ab-324fe4c7c69c tempest-CreateVolumesFromImageTest-672512528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-08f7cbbe-f75c-4aa8-91ab-324fe4c7c69c tempest-CreateVolumesFromImageTest-672512528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-08f7cbbe-f75c-4aa8-91ab-324fe4c7c69c tempest-CreateVolumesFromImageTest-672512528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-08f7cbbe-f75c-4aa8-91ab-324fe4c7c69c tempest-CreateVolumesFromImageTest-672512528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-08f7cbbe-f75c-4aa8-91ab-324fe4c7c69c tempest-CreateVolumesFromImageTest-672512528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:07 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:55:07 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] Flow 'volume_create_manager' (8eb6a4e6-2231-4ddb-98ba-fadb692095be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d908b37-a578-4a5e-b5b9-e1ffb25e9eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d908b37-a578-4a5e-b5b9-e1ffb25e9eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1130678724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b0fdb5c-c761-471a-ae21-0f2e3103b07d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb8c854877f426fb8f1231420d1b8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:07Z,use_quota=True,user_id='3876d46298f4486c962117cdfa6a0e8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14966029-7736-45cf-af51-14a24eac0b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14966029-7736-45cf-af51-14a24eac0b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae536bb4-68b6-41b8-9e39-c6bf9e053335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae536bb4-68b6-41b8-9e39-c6bf9e053335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b0fdb5c-c761-471a-ae21-0f2e3103b07d', 'volume_name': 'volume-3b0fdb5c-c761-471a-ae21-0f2e3103b07d', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd377f7-6208-453e-aa2c-5b223d78c763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd377f7-6208-453e-aa2c-5b223d78c763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2728fe9d-27dc-4c46-bddd-12f9dc9a18ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:07 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] Volume 3b0fdb5c-c761-471a-ae21-0f2e3103b07d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b0fdb5c-c761-471a-ae21-0f2e3103b07d', 'volume_size': 1} Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:07 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f74b122c-b73d-4da3-9ce1-6dbf67cefa56 1073741824" returned: 0 in 0.558s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f74b122c-b73d-4da3-9ce1-6dbf67cefa56 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:07 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:07 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f74b122c-b73d-4da3-9ce1-6dbf67cefa56 Jul 17 19:55:07 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-08f7cbbe-f75c-4aa8-91ab-324fe4c7c69c tempest-CreateVolumesFromImageTest-672512528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.291s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-08f7cbbe-f75c-4aa8-91ab-324fe4c7c69c tempest-CreateVolumesFromImageTest-672512528 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:55:07 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-08f7cbbe-f75c-4aa8-91ab-324fe4c7c69c tempest-CreateVolumesFromImageTest-672512528 None] Deleted volume successfully. Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-08f7cbbe-f75c-4aa8-91ab-324fe4c7c69c tempest-CreateVolumesFromImageTest-672512528 None] Lock "cinder-8ce201fe-7407-4843-91de-12edb8457a5c-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:07 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f74b122c-b73d-4da3-9ce1-6dbf67cefa56" returned: 0 in 0.253s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.905s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1660481866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c633763b-804b-4406-af64-185bf2a938f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b2be4e9615542419539ebcaf9fb2245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:01Z,use_quota=True,user_id='0bbe18c147cb4209868af1ba8bd41498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Creating volume c633763b-804b-4406-af64-185bf2a938f3 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:55:07 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c633763b-804b-4406-af64-185bf2a938f3 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6ede152-441f-405a-a1fb-7b02d766cbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f74b122c-b73d-4da3-9ce1-6dbf67cefa56', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:07 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c633763b-804b-4406-af64-185bf2a938f3 1073741824 Jul 17 19:55:07 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (085ffed6-07a6-48d4-a5b8-baaf86ebfc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:07 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Volume volume-f74b122c-b73d-4da3-9ce1-6dbf67cefa56 (f74b122c-b73d-4da3-9ce1-6dbf67cefa56): created successfully Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (085ffed6-07a6-48d4-a5b8-baaf86ebfc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Flow 'volume_create_manager' (e7691490-6956-4471-b0f7-4dc547198f49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:07 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-8ff2205b-2670-411a-86b9-338856e9bde7 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Created volume successfully. Jul 17 19:55:07 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c633763b-804b-4406-af64-185bf2a938f3 1073741824" returned: 0 in 0.438s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6fdda3a9-5405-41a4-9147-db01ec9b478a tempest-CreateVolumesFromImageTest-672512528 None] Acquiring lock "cinder-26bab4e0-538c-4d29-83e6-4cad92f5978b-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:07 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6fdda3a9-5405-41a4-9147-db01ec9b478a tempest-CreateVolumesFromImageTest-672512528 None] Lock "cinder-26bab4e0-538c-4d29-83e6-4cad92f5978b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c633763b-804b-4406-af64-185bf2a938f3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:08 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c633763b-804b-4406-af64-185bf2a938f3 Jul 17 19:55:08 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6fdda3a9-5405-41a4-9147-db01ec9b478a tempest-CreateVolumesFromImageTest-672512528 None] Acquiring lock "cinder-quobyte-26bab4e0-538c-4d29-83e6-4cad92f5978b" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6fdda3a9-5405-41a4-9147-db01ec9b478a tempest-CreateVolumesFromImageTest-672512528 None] Lock "cinder-quobyte-26bab4e0-538c-4d29-83e6-4cad92f5978b" acquired by "delete_volume" :: waited 0.014s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[3157985d-637a-471a-ad2b-ac4be79ab03d]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6fdda3a9-5405-41a4-9147-db01ec9b478a tempest-CreateVolumesFromImageTest-672512528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-26bab4e0-538c-4d29-83e6-4cad92f5978b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:08 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-26bab4e0-538c-4d29-83e6-4cad92f5978b Jul 17 19:55:08 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:08 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c633763b-804b-4406-af64-185bf2a938f3" returned: 0 in 0.246s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.321s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-52679469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ea15c9-1d9f-473c-a733-9442951dc666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b2be4e9615542419539ebcaf9fb2245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:02Z,use_quota=True,user_id='0bbe18c147cb4209868af1ba8bd41498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Creating volume 93ea15c9-1d9f-473c-a733-9442951dc666 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:55:08 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-93ea15c9-1d9f-473c-a733-9442951dc666 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9c3277d-ad6a-472d-9ab0-9acac58e388e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c633763b-804b-4406-af64-185bf2a938f3', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:08 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-93ea15c9-1d9f-473c-a733-9442951dc666 1073741824 Jul 17 19:55:08 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d81fd995-1ef5-45de-b619-81fcbfc392dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:08 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Volume volume-c633763b-804b-4406-af64-185bf2a938f3 (c633763b-804b-4406-af64-185bf2a938f3): created successfully Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d81fd995-1ef5-45de-b619-81fcbfc392dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Flow 'volume_create_manager' (5ef319ff-37b1-41c2-99ff-bc4812773d2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:08 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-ffce0a07-e75a-4d0b-b258-538518fec409 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Created volume successfully. Jul 17 19:55:08 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6fdda3a9-5405-41a4-9147-db01ec9b478a tempest-CreateVolumesFromImageTest-672512528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-26bab4e0-538c-4d29-83e6-4cad92f5978b" returned: 0 in 0.393s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6fdda3a9-5405-41a4-9147-db01ec9b478a tempest-CreateVolumesFromImageTest-672512528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-26bab4e0-538c-4d29-83e6-4cad92f5978b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:08 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-26bab4e0-538c-4d29-83e6-4cad92f5978b Jul 17 19:55:08 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:08 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6fdda3a9-5405-41a4-9147-db01ec9b478a tempest-CreateVolumesFromImageTest-672512528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-26bab4e0-538c-4d29-83e6-4cad92f5978b" returned: 0 in 0.274s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:08 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-93ea15c9-1d9f-473c-a733-9442951dc666 1073741824" returned: 0 in 0.475s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6fdda3a9-5405-41a4-9147-db01ec9b478a tempest-CreateVolumesFromImageTest-672512528 None] Lock "cinder-quobyte-26bab4e0-538c-4d29-83e6-4cad92f5978b" released by "delete_volume" :: held 0.711s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-93ea15c9-1d9f-473c-a733-9442951dc666 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-6fdda3a9-5405-41a4-9147-db01ec9b478a tempest-CreateVolumesFromImageTest-672512528 None] Created reservations ['4735d902-7745-4436-89f2-eb5a3e92f608', 'd5f1dd12-9373-4598-8514-12610463f1e4', '12f8280b-bdec-46f9-8b3d-f59c9b59a898', '06611a61-ece6-4dc1-b7f0-0e3e1bb8b4bb'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:08 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-93ea15c9-1d9f-473c-a733-9442951dc666 Jul 17 19:55:08 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6fdda3a9-5405-41a4-9147-db01ec9b478a tempest-CreateVolumesFromImageTest-672512528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6fdda3a9-5405-41a4-9147-db01ec9b478a tempest-CreateVolumesFromImageTest-672512528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6fdda3a9-5405-41a4-9147-db01ec9b478a tempest-CreateVolumesFromImageTest-672512528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6fdda3a9-5405-41a4-9147-db01ec9b478a tempest-CreateVolumesFromImageTest-672512528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6fdda3a9-5405-41a4-9147-db01ec9b478a tempest-CreateVolumesFromImageTest-672512528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6fdda3a9-5405-41a4-9147-db01ec9b478a tempest-CreateVolumesFromImageTest-672512528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:08 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:55:08 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:09 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-93ea15c9-1d9f-473c-a733-9442951dc666" returned: 0 in 0.252s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.095s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2565bf6d-0e97-4862-a832-fa5ae58e3f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9645f1410e194dc29b3dfb68231c2e39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:00Z,use_quota=True,user_id='407957ee93a84650aa441180dd713952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98e62150-c297-4120-97f9-3bf4b1ad388f),volume_type_id=98e62150-c297-4120-97f9-3bf4b1ad388f)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Creating volume 2565bf6d-0e97-4862-a832-fa5ae58e3f90 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:55:09 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2565bf6d-0e97-4862-a832-fa5ae58e3f90 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bde2b32-25e2-4b25-89ea-e1d09a13355b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93ea15c9-1d9f-473c-a733-9442951dc666', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:09 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2565bf6d-0e97-4862-a832-fa5ae58e3f90 1073741824 Jul 17 19:55:09 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c1270aa-3ac6-44f0-8fe3-194cb0de211e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:09 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Volume volume-93ea15c9-1d9f-473c-a733-9442951dc666 (93ea15c9-1d9f-473c-a733-9442951dc666): created successfully Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c1270aa-3ac6-44f0-8fe3-194cb0de211e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Flow 'volume_create_manager' (1e7f6fb0-f7f6-40c0-93f1-ffa8d3b930e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-67efeee8-49e4-4135-bdde-d143cc97deac tempest-CreateVolumesFromImageTest-672512528 None] Acquiring lock "cinder-c23bfca8-4f2e-49f4-8a82-4c13455b595c-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:09 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-02744db0-8591-4e6d-bf3c-ac283e553987 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Created volume successfully. Jul 17 19:55:09 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-67efeee8-49e4-4135-bdde-d143cc97deac tempest-CreateVolumesFromImageTest-672512528 None] Lock "cinder-c23bfca8-4f2e-49f4-8a82-4c13455b595c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6fdda3a9-5405-41a4-9147-db01ec9b478a tempest-CreateVolumesFromImageTest-672512528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.292s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-6fdda3a9-5405-41a4-9147-db01ec9b478a tempest-CreateVolumesFromImageTest-672512528 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:55:09 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-6fdda3a9-5405-41a4-9147-db01ec9b478a tempest-CreateVolumesFromImageTest-672512528 None] Deleted volume successfully. Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6fdda3a9-5405-41a4-9147-db01ec9b478a tempest-CreateVolumesFromImageTest-672512528 None] Lock "cinder-26bab4e0-538c-4d29-83e6-4cad92f5978b-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-67efeee8-49e4-4135-bdde-d143cc97deac tempest-CreateVolumesFromImageTest-672512528 None] Acquiring lock "cinder-quobyte-c23bfca8-4f2e-49f4-8a82-4c13455b595c" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-67efeee8-49e4-4135-bdde-d143cc97deac tempest-CreateVolumesFromImageTest-672512528 None] Lock "cinder-quobyte-c23bfca8-4f2e-49f4-8a82-4c13455b595c" acquired by "delete_volume" :: waited 0.014s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[139b9f80-b8da-46df-9eb9-c87cbf0e01d6]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-67efeee8-49e4-4135-bdde-d143cc97deac tempest-CreateVolumesFromImageTest-672512528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c23bfca8-4f2e-49f4-8a82-4c13455b595c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:09 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c23bfca8-4f2e-49f4-8a82-4c13455b595c Jul 17 19:55:09 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:09 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2565bf6d-0e97-4862-a832-fa5ae58e3f90 1073741824" returned: 0 in 0.468s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2565bf6d-0e97-4862-a832-fa5ae58e3f90 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:09 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2565bf6d-0e97-4862-a832-fa5ae58e3f90 Jul 17 19:55:09 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-458f5bf9-0d71-4029-8070-0228a16389be tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Acquiring lock "cinder-93ea15c9-1d9f-473c-a733-9442951dc666-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-458f5bf9-0d71-4029-8070-0228a16389be tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "cinder-93ea15c9-1d9f-473c-a733-9442951dc666-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:09 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-67efeee8-49e4-4135-bdde-d143cc97deac tempest-CreateVolumesFromImageTest-672512528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c23bfca8-4f2e-49f4-8a82-4c13455b595c" returned: 0 in 0.410s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-67efeee8-49e4-4135-bdde-d143cc97deac tempest-CreateVolumesFromImageTest-672512528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c23bfca8-4f2e-49f4-8a82-4c13455b595c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-458f5bf9-0d71-4029-8070-0228a16389be tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Acquiring lock "cinder-quobyte-93ea15c9-1d9f-473c-a733-9442951dc666" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:09 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c23bfca8-4f2e-49f4-8a82-4c13455b595c Jul 17 19:55:09 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-458f5bf9-0d71-4029-8070-0228a16389be tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "cinder-quobyte-93ea15c9-1d9f-473c-a733-9442951dc666" acquired by "delete_volume" :: waited 0.021s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af6bc48-f61f-40b4-a511-79b5b5310937]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-458f5bf9-0d71-4029-8070-0228a16389be tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-93ea15c9-1d9f-473c-a733-9442951dc666 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:09 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2565bf6d-0e97-4862-a832-fa5ae58e3f90" returned: 0 in 0.297s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.790s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2090082462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00954b0e-af6a-4907-81a2-443a796cec13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb8c854877f426fb8f1231420d1b8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:05Z,use_quota=True,user_id='3876d46298f4486c962117cdfa6a0e8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Creating volume 00954b0e-af6a-4907-81a2-443a796cec13 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:09 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-93ea15c9-1d9f-473c-a733-9442951dc666 Jul 17 19:55:09 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:55:09 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-00954b0e-af6a-4907-81a2-443a796cec13 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:09 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-00954b0e-af6a-4907-81a2-443a796cec13 1073741824 Jul 17 19:55:09 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG cinder.volume.volume_utils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Attempting download of c35edaca-b68f-4802-afe5-5e48434ee2e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/c35edaca-b68f-4802-afe5-5e48434ee2e6', 'metadata': {}}])) to volume 2565bf6d-0e97-4862-a832-fa5ae58e3f90. {{(pid=87726) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 19:55:09 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-67efeee8-49e4-4135-bdde-d143cc97deac tempest-CreateVolumesFromImageTest-672512528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c23bfca8-4f2e-49f4-8a82-4c13455b595c" returned: 0 in 0.297s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db9fba7-6ae9-41d4-b43b-971d20d57ef5]: (4, 'raw') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c35edaca-b68f-4802-afe5-5e48434ee2e6_97zvgnm3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-67efeee8-49e4-4135-bdde-d143cc97deac tempest-CreateVolumesFromImageTest-672512528 None] Lock "cinder-quobyte-c23bfca8-4f2e-49f4-8a82-4c13455b595c" released by "delete_volume" :: held 0.766s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-67efeee8-49e4-4135-bdde-d143cc97deac tempest-CreateVolumesFromImageTest-672512528 None] Created reservations ['a34ffb4c-088c-4d94-b8ca-85b51950e6e4', '1423db73-7ae3-4c23-82ed-d14540c61027', 'd0ca30dc-88d7-40ff-a8c5-a34480c3d653', '0e3f724f-c0e6-4d9f-b0f2-38944c68e77d'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-67efeee8-49e4-4135-bdde-d143cc97deac tempest-CreateVolumesFromImageTest-672512528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-67efeee8-49e4-4135-bdde-d143cc97deac tempest-CreateVolumesFromImageTest-672512528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-67efeee8-49e4-4135-bdde-d143cc97deac tempest-CreateVolumesFromImageTest-672512528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:10 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c35edaca-b68f-4802-afe5-5e48434ee2e6_97zvgnm3 Jul 17 19:55:10 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-67efeee8-49e4-4135-bdde-d143cc97deac tempest-CreateVolumesFromImageTest-672512528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-67efeee8-49e4-4135-bdde-d143cc97deac tempest-CreateVolumesFromImageTest-672512528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-67efeee8-49e4-4135-bdde-d143cc97deac tempest-CreateVolumesFromImageTest-672512528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:10 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:55:10 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:10 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-458f5bf9-0d71-4029-8070-0228a16389be tempest-CreateVolumesFromSourceVolumeTest-919231596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-93ea15c9-1d9f-473c-a733-9442951dc666" returned: 0 in 0.463s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-458f5bf9-0d71-4029-8070-0228a16389be tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-93ea15c9-1d9f-473c-a733-9442951dc666 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:10 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-93ea15c9-1d9f-473c-a733-9442951dc666 Jul 17 19:55:10 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1c713436-6a9b-41cd-b73f-e8c13290298b tempest-CreateVolumesFromImageTest-672512528 None] Acquiring lock "cinder-5cbb9435-6069-4837-b50b-e2c0b2afeef5-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1c713436-6a9b-41cd-b73f-e8c13290298b tempest-CreateVolumesFromImageTest-672512528 None] Lock "cinder-5cbb9435-6069-4837-b50b-e2c0b2afeef5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:10 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c35edaca-b68f-4802-afe5-5e48434ee2e6_97zvgnm3" returned: 0 in 0.454s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c35edaca-b68f-4802-afe5-5e48434ee2e6_97zvgnm3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:10 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1c713436-6a9b-41cd-b73f-e8c13290298b tempest-CreateVolumesFromImageTest-672512528 None] Acquiring lock "cinder-quobyte-5cbb9435-6069-4837-b50b-e2c0b2afeef5" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-00954b0e-af6a-4907-81a2-443a796cec13 1073741824" returned: 0 in 0.587s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1c713436-6a9b-41cd-b73f-e8c13290298b tempest-CreateVolumesFromImageTest-672512528 None] Lock "cinder-quobyte-5cbb9435-6069-4837-b50b-e2c0b2afeef5" acquired by "delete_volume" :: waited 0.039s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:10 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-67efeee8-49e4-4135-bdde-d143cc97deac tempest-CreateVolumesFromImageTest-672512528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.375s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-67efeee8-49e4-4135-bdde-d143cc97deac tempest-CreateVolumesFromImageTest-672512528 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d111763-9955-4b87-a4b7-b4c1efc6fe5a]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1c713436-6a9b-41cd-b73f-e8c13290298b tempest-CreateVolumesFromImageTest-672512528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cbb9435-6069-4837-b50b-e2c0b2afeef5 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:10 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-67efeee8-49e4-4135-bdde-d143cc97deac tempest-CreateVolumesFromImageTest-672512528 None] Deleted volume successfully. Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-00954b0e-af6a-4907-81a2-443a796cec13 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:10 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:10 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c35edaca-b68f-4802-afe5-5e48434ee2e6_97zvgnm3 Jul 17 19:55:10 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-67efeee8-49e4-4135-bdde-d143cc97deac tempest-CreateVolumesFromImageTest-672512528 None] Lock "cinder-c23bfca8-4f2e-49f4-8a82-4c13455b595c-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-458f5bf9-0d71-4029-8070-0228a16389be tempest-CreateVolumesFromSourceVolumeTest-919231596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-93ea15c9-1d9f-473c-a733-9442951dc666" returned: 0 in 0.371s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-458f5bf9-0d71-4029-8070-0228a16389be tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "cinder-quobyte-93ea15c9-1d9f-473c-a733-9442951dc666" released by "delete_volume" :: held 0.888s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:10 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-00954b0e-af6a-4907-81a2-443a796cec13 Jul 17 19:55:10 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-458f5bf9-0d71-4029-8070-0228a16389be tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Created reservations ['c2b45e2a-106c-4093-86a8-781f1fe9d45e', '82193e16-e04c-46c7-a896-521ba1149ffb', '9a020ee9-4465-4687-a77a-33abbc94f5fd', '41f6ff80-08f9-4746-9c65-2d7f8d9821d5'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:10 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cbb9435-6069-4837-b50b-e2c0b2afeef5 Jul 17 19:55:10 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-458f5bf9-0d71-4029-8070-0228a16389be tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-458f5bf9-0d71-4029-8070-0228a16389be tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-458f5bf9-0d71-4029-8070-0228a16389be tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-458f5bf9-0d71-4029-8070-0228a16389be tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-458f5bf9-0d71-4029-8070-0228a16389be tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-458f5bf9-0d71-4029-8070-0228a16389be tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:10 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:55:10 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1a7772f3-2698-4908-82b1-2154efb83475 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Acquiring lock "cinder-c633763b-804b-4406-af64-185bf2a938f3-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1a7772f3-2698-4908-82b1-2154efb83475 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "cinder-c633763b-804b-4406-af64-185bf2a938f3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:10 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c35edaca-b68f-4802-afe5-5e48434ee2e6_97zvgnm3" returned: 1 in 0.522s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c35edaca-b68f-4802-afe5-5e48434ee2e6_97zvgnm3' failed. Not Retrying. {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1a7772f3-2698-4908-82b1-2154efb83475 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Acquiring lock "cinder-quobyte-c633763b-804b-4406-af64-185bf2a938f3" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed878112-dd83-413a-a6cb-4670c0c82006]: (4, 'raw') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c35edaca-b68f-4802-afe5-5e48434ee2e6_n2uivm2ydevstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:11 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-00954b0e-af6a-4907-81a2-443a796cec13" returned: 0 in 0.429s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1a7772f3-2698-4908-82b1-2154efb83475 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "cinder-quobyte-c633763b-804b-4406-af64-185bf2a938f3" acquired by "delete_volume" :: waited 0.041s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.557s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1161228432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2894991-2cbc-4c8e-9843-2c1c38b0d1b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb8c854877f426fb8f1231420d1b8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:05Z,use_quota=True,user_id='3876d46298f4486c962117cdfa6a0e8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Creating volume d2894991-2cbc-4c8e-9843-2c1c38b0d1b5 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:55:11 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d2894991-2cbc-4c8e-9843-2c1c38b0d1b5 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3adb18-e5e1-432d-a312-1181f8999d4b]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1a7772f3-2698-4908-82b1-2154efb83475 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c633763b-804b-4406-af64-185bf2a938f3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:11 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d2894991-2cbc-4c8e-9843-2c1c38b0d1b5 1073741824 Jul 17 19:55:11 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ab245a-fcd8-4030-9685-f192900f6cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00954b0e-af6a-4907-81a2-443a796cec13', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b39dad-19ed-4024-a896-3d7f4a89e4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:11 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:11 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Volume volume-00954b0e-af6a-4907-81a2-443a796cec13 (00954b0e-af6a-4907-81a2-443a796cec13): created successfully Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b39dad-19ed-4024-a896-3d7f4a89e4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Flow 'volume_create_manager' (7c24b17f-5d3d-461f-bb35-51faa0ed8270) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1c713436-6a9b-41cd-b73f-e8c13290298b tempest-CreateVolumesFromImageTest-672512528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cbb9435-6069-4837-b50b-e2c0b2afeef5" returned: 0 in 0.596s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1c713436-6a9b-41cd-b73f-e8c13290298b tempest-CreateVolumesFromImageTest-672512528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cbb9435-6069-4837-b50b-e2c0b2afeef5 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:11 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c35edaca-b68f-4802-afe5-5e48434ee2e6_n2uivm2ydevstack@QuobyteHD Jul 17 19:55:11 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:11 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-458f5bf9-0d71-4029-8070-0228a16389be tempest-CreateVolumesFromSourceVolumeTest-919231596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.411s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-458f5bf9-0d71-4029-8070-0228a16389be tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:55:11 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cbb9435-6069-4837-b50b-e2c0b2afeef5 Jul 17 19:55:11 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:11 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-21008054-80d3-400a-a686-e46d2b93c4b5 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Created volume successfully. Jul 17 19:55:11 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-458f5bf9-0d71-4029-8070-0228a16389be tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Deleted volume successfully. Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-458f5bf9-0d71-4029-8070-0228a16389be tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "cinder-93ea15c9-1d9f-473c-a733-9442951dc666-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:11 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c633763b-804b-4406-af64-185bf2a938f3 Jul 17 19:55:11 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:11 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c35edaca-b68f-4802-afe5-5e48434ee2e6_n2uivm2ydevstack@QuobyteHD" returned: 0 in 0.483s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c35edaca-b68f-4802-afe5-5e48434ee2e6_n2uivm2ydevstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:11 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1c713436-6a9b-41cd-b73f-e8c13290298b tempest-CreateVolumesFromImageTest-672512528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5cbb9435-6069-4837-b50b-e2c0b2afeef5" returned: 0 in 0.403s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1c713436-6a9b-41cd-b73f-e8c13290298b tempest-CreateVolumesFromImageTest-672512528 None] Lock "cinder-quobyte-5cbb9435-6069-4837-b50b-e2c0b2afeef5" released by "delete_volume" :: held 1.052s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:11 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1a7772f3-2698-4908-82b1-2154efb83475 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c633763b-804b-4406-af64-185bf2a938f3" returned: 0 in 0.517s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1a7772f3-2698-4908-82b1-2154efb83475 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c633763b-804b-4406-af64-185bf2a938f3 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:11 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c35edaca-b68f-4802-afe5-5e48434ee2e6_n2uivm2ydevstack@QuobyteHD Jul 17 19:55:11 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:11 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c633763b-804b-4406-af64-185bf2a938f3 Jul 17 19:55:11 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-1c713436-6a9b-41cd-b73f-e8c13290298b tempest-CreateVolumesFromImageTest-672512528 None] Created reservations ['86347b6e-3fef-4710-bbc3-d3d04446ddf2', 'ef2b743c-ecf8-4b74-acd0-a6968473bd47', 'ef63aa1c-8655-4628-8f9c-6c3f06dd83bc', '3444a1b3-ea1a-48bd-bc13-aaf8c8ebe2f8'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:11 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d2894991-2cbc-4c8e-9843-2c1c38b0d1b5 1073741824" returned: 0 in 0.692s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1c713436-6a9b-41cd-b73f-e8c13290298b tempest-CreateVolumesFromImageTest-672512528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1c713436-6a9b-41cd-b73f-e8c13290298b tempest-CreateVolumesFromImageTest-672512528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-1c713436-6a9b-41cd-b73f-e8c13290298b tempest-CreateVolumesFromImageTest-672512528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-1c713436-6a9b-41cd-b73f-e8c13290298b tempest-CreateVolumesFromImageTest-672512528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1c713436-6a9b-41cd-b73f-e8c13290298b tempest-CreateVolumesFromImageTest-672512528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1c713436-6a9b-41cd-b73f-e8c13290298b tempest-CreateVolumesFromImageTest-672512528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d2894991-2cbc-4c8e-9843-2c1c38b0d1b5 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:11 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:55:11 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:11 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d2894991-2cbc-4c8e-9843-2c1c38b0d1b5 Jul 17 19:55:11 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:11 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c35edaca-b68f-4802-afe5-5e48434ee2e6_n2uivm2ydevstack@QuobyteHD" returned: 1 in 0.398s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c35edaca-b68f-4802-afe5-5e48434ee2e6_n2uivm2ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] c35edaca-b68f-4802-afe5-5e48434ee2e6 was raw, converting to qcow2 {{(pid=87726) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c35edaca-b68f-4802-afe5-5e48434ee2e6_n2uivm2ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2565bf6d-0e97-4862-a832-fa5ae58e3f90 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:11 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c35edaca-b68f-4802-afe5-5e48434ee2e6_n2uivm2ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2565bf6d-0e97-4862-a832-fa5ae58e3f90 Jul 17 19:55:11 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:11 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1a7772f3-2698-4908-82b1-2154efb83475 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c633763b-804b-4406-af64-185bf2a938f3" returned: 0 in 0.348s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:11 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1a7772f3-2698-4908-82b1-2154efb83475 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "cinder-quobyte-c633763b-804b-4406-af64-185bf2a938f3" released by "delete_volume" :: held 0.929s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-1a7772f3-2698-4908-82b1-2154efb83475 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Created reservations ['5a5add12-4b68-4efb-a164-0817d06b19ae', '515705f7-20c6-4cb0-9c2c-80a753ad084d', '81f15cb7-b494-43ed-8ffe-72d0a4a00c50', '1300371f-90b5-46f4-a97b-6f7a55aae272'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1a7772f3-2698-4908-82b1-2154efb83475 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1a7772f3-2698-4908-82b1-2154efb83475 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-1a7772f3-2698-4908-82b1-2154efb83475 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:12 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-1a7772f3-2698-4908-82b1-2154efb83475 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-1a7772f3-2698-4908-82b1-2154efb83475 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1a7772f3-2698-4908-82b1-2154efb83475 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1c713436-6a9b-41cd-b73f-e8c13290298b tempest-CreateVolumesFromImageTest-672512528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.325s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-1c713436-6a9b-41cd-b73f-e8c13290298b tempest-CreateVolumesFromImageTest-672512528 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:55:12 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-1c713436-6a9b-41cd-b73f-e8c13290298b tempest-CreateVolumesFromImageTest-672512528 None] Deleted volume successfully. Jul 17 19:55:12 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:55:12 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1c713436-6a9b-41cd-b73f-e8c13290298b tempest-CreateVolumesFromImageTest-672512528 None] Lock "cinder-5cbb9435-6069-4837-b50b-e2c0b2afeef5-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:12 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d2894991-2cbc-4c8e-9843-2c1c38b0d1b5" returned: 0 in 0.351s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-550035804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=259a4b3f-4159-4190-b29c-025e657770b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb8c854877f426fb8f1231420d1b8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:06Z,use_quota=True,user_id='3876d46298f4486c962117cdfa6a0e8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] Creating volume 259a4b3f-4159-4190-b29c-025e657770b2 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:55:12 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-259a4b3f-4159-4190-b29c-025e657770b2 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc4f2d3-d177-41c0-b455-af8d41d8d114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2894991-2cbc-4c8e-9843-2c1c38b0d1b5', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:12 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-259a4b3f-4159-4190-b29c-025e657770b2 1073741824 Jul 17 19:55:12 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f803d49-0ba6-42fc-86ee-647ee3615549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:12 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Volume volume-d2894991-2cbc-4c8e-9843-2c1c38b0d1b5 (d2894991-2cbc-4c8e-9843-2c1c38b0d1b5): created successfully Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f803d49-0ba6-42fc-86ee-647ee3615549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Flow 'volume_create_manager' (974815c7-7836-49e9-83f6-d3fb8ff489de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:12 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-124a8be2-9d9e-418e-8e86-d9c689a44bc4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Created volume successfully. Jul 17 19:55:12 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1a7772f3-2698-4908-82b1-2154efb83475 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.289s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-1a7772f3-2698-4908-82b1-2154efb83475 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:55:12 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-1a7772f3-2698-4908-82b1-2154efb83475 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Deleted volume successfully. Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1a7772f3-2698-4908-82b1-2154efb83475 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "cinder-c633763b-804b-4406-af64-185bf2a938f3-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:12 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c35edaca-b68f-4802-afe5-5e48434ee2e6_n2uivm2ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2565bf6d-0e97-4862-a832-fa5ae58e3f90" returned: 0 in 0.605s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c35edaca-b68f-4802-afe5-5e48434ee2e6_n2uivm2ydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2565bf6d-0e97-4862-a832-fa5ae58e3f90 {{(pid=87726) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 19:55:12 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Converted 0.00 MB image at 0.00 MB/s Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2565bf6d-0e97-4862-a832-fa5ae58e3f90 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:12 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2565bf6d-0e97-4862-a832-fa5ae58e3f90 1G Jul 17 19:55:12 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c9f63c6f-6995-47b8-8503-931b275753ec tempest-CreateVolumesFromImageTest-672512528 None] Acquiring lock "cinder-69905842-faa7-49c0-8f87-7ac0fc7aac36-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c9f63c6f-6995-47b8-8503-931b275753ec tempest-CreateVolumesFromImageTest-672512528 None] Lock "cinder-69905842-faa7-49c0-8f87-7ac0fc7aac36-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c9f63c6f-6995-47b8-8503-931b275753ec tempest-CreateVolumesFromImageTest-672512528 None] Acquiring lock "cinder-quobyte-69905842-faa7-49c0-8f87-7ac0fc7aac36" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c9f63c6f-6995-47b8-8503-931b275753ec tempest-CreateVolumesFromImageTest-672512528 None] Lock "cinder-quobyte-69905842-faa7-49c0-8f87-7ac0fc7aac36" acquired by "delete_volume" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:12 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-259a4b3f-4159-4190-b29c-025e657770b2 1073741824" returned: 0 in 0.529s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[0606f902-c9a8-452f-b3fc-4799c5e4418b]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c9f63c6f-6995-47b8-8503-931b275753ec tempest-CreateVolumesFromImageTest-672512528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69905842-faa7-49c0-8f87-7ac0fc7aac36 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-259a4b3f-4159-4190-b29c-025e657770b2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:12 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-259a4b3f-4159-4190-b29c-025e657770b2 Jul 17 19:55:12 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:12 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69905842-faa7-49c0-8f87-7ac0fc7aac36 Jul 17 19:55:12 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2565bf6d-0e97-4862-a832-fa5ae58e3f90 1G" returned: 0 in 0.362s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:12 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.volume.volume_utils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Downloaded image c35edaca-b68f-4802-afe5-5e48434ee2e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/c35edaca-b68f-4802-afe5-5e48434ee2e6', 'metadata': {}}])) to volume 2565bf6d-0e97-4862-a832-fa5ae58e3f90 successfully. {{(pid=87726) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Temporary image c35edaca-b68f-4802-afe5-5e48434ee2e6 for user 407957ee93a84650aa441180dd713952 is deleted. {{(pid=87726) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.volume.volume_utils [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Marking volume 2565bf6d-0e97-4862-a832-fa5ae58e3f90 as bootable. {{(pid=87726) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Copying metadata from image c35edaca-b68f-4802-afe5-5e48434ee2e6 to 2565bf6d-0e97-4862-a832-fa5ae58e3f90. {{(pid=87726) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Creating volume glance metadata for volume 2565bf6d-0e97-4862-a832-fa5ae58e3f90 backed by image c35edaca-b68f-4802-afe5-5e48434ee2e6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c35edaca-b68f-4802-afe5-5e48434ee2e6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a7f08cf0a57df4cccfef6682332e39d1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87726) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f956bda8-6cc9-4fef-a498-8c4393c0b7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2565bf6d-0e97-4862-a832-fa5ae58e3f90', 'volume_size': 1, 'image_id': 'c35edaca-b68f-4802-afe5-5e48434ee2e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c35edaca-b68f-4802-afe5-5e48434ee2e6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a7f08cf0a57df4cccfef6682332e39d1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9645f1410e194dc29b3dfb68231c2e39', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f806e187642c1ebc8f616095c8b203ce593cdb34492e683157be4fe226250bf8ef1d23c20bd69ada99fe985655104021afb52c07ca28af77d7a865bcd3838b56', 'id': 'c35edaca-b68f-4802-afe5-5e48434ee2e6', 'created_at': datetime.datetime(2026, 7, 17, 17, 54, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 17, 54, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c35edaca-b68f-4802-afe5-5e48434ee2e6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67961901-eb75-4402-8f15-10afc49d9e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:12 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Volume volume-2565bf6d-0e97-4862-a832-fa5ae58e3f90 (2565bf6d-0e97-4862-a832-fa5ae58e3f90): created successfully Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67961901-eb75-4402-8f15-10afc49d9e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Flow 'volume_create_manager' (ab63c44f-e039-45b1-ae5a-e7b2e31d357b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:12 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-a50119cd-fb0b-4ebb-908f-97bcb4bd935b tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Created volume successfully. Jul 17 19:55:13 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-259a4b3f-4159-4190-b29c-025e657770b2" returned: 0 in 0.296s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.364s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2044426916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ab168a-2ac4-4899-b76b-c0f260c08535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb8c854877f426fb8f1231420d1b8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:06Z,use_quota=True,user_id='3876d46298f4486c962117cdfa6a0e8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Creating volume 75ab168a-2ac4-4899-b76b-c0f260c08535 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:55:13 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75ab168a-2ac4-4899-b76b-c0f260c08535 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-282822cc-baf7-4ffc-8dcb-51ea5895bfbb tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Acquiring lock "cinder-2565bf6d-0e97-4862-a832-fa5ae58e3f90-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd1d8e9-dab4-4c4f-ac85-d409f205dca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-259a4b3f-4159-4190-b29c-025e657770b2', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:13 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75ab168a-2ac4-4899-b76b-c0f260c08535 1073741824 Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fcb2190-a1ae-4c3b-a205-2b61bd559d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:13 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:13 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] Volume volume-259a4b3f-4159-4190-b29c-025e657770b2 (259a4b3f-4159-4190-b29c-025e657770b2): created successfully Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fcb2190-a1ae-4c3b-a205-2b61bd559d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] Flow 'volume_create_manager' (4165ad9e-7e51-441a-9135-05332706eb20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-282822cc-baf7-4ffc-8dcb-51ea5895bfbb tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Lock "cinder-2565bf6d-0e97-4862-a832-fa5ae58e3f90-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c61e4ac8-cdae-41cd-9da2-6b99b0a556d0 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Acquiring lock "cinder-f74b122c-b73d-4da3-9ce1-6dbf67cefa56-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:13 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e8146cbc-1f5a-473d-987b-3ebc0ef2c6da tempest-CreateVolumesFromSnapshotTest-1952803094 None] Created volume successfully. Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c61e4ac8-cdae-41cd-9da2-6b99b0a556d0 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "cinder-f74b122c-b73d-4da3-9ce1-6dbf67cefa56-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:13 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-282822cc-baf7-4ffc-8dcb-51ea5895bfbb tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Acquiring lock "cinder-quobyte-2565bf6d-0e97-4862-a832-fa5ae58e3f90" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c9f63c6f-6995-47b8-8503-931b275753ec tempest-CreateVolumesFromImageTest-672512528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69905842-faa7-49c0-8f87-7ac0fc7aac36" returned: 0 in 0.519s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c9f63c6f-6995-47b8-8503-931b275753ec tempest-CreateVolumesFromImageTest-672512528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69905842-faa7-49c0-8f87-7ac0fc7aac36 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:13 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69905842-faa7-49c0-8f87-7ac0fc7aac36 Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c61e4ac8-cdae-41cd-9da2-6b99b0a556d0 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Acquiring lock "cinder-quobyte-f74b122c-b73d-4da3-9ce1-6dbf67cefa56" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:13 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-282822cc-baf7-4ffc-8dcb-51ea5895bfbb tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Lock "cinder-quobyte-2565bf6d-0e97-4862-a832-fa5ae58e3f90" acquired by "delete_volume" :: waited 0.052s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c61e4ac8-cdae-41cd-9da2-6b99b0a556d0 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "cinder-quobyte-f74b122c-b73d-4da3-9ce1-6dbf67cefa56" acquired by "delete_volume" :: waited 0.038s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6998e5b-3448-4312-acbf-20b016c53f37]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-282822cc-baf7-4ffc-8dcb-51ea5895bfbb tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2565bf6d-0e97-4862-a832-fa5ae58e3f90 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85e26f9-73e6-4e5f-9552-e0b6f32d016a]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c61e4ac8-cdae-41cd-9da2-6b99b0a556d0 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f74b122c-b73d-4da3-9ce1-6dbf67cefa56 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:13 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2565bf6d-0e97-4862-a832-fa5ae58e3f90 Jul 17 19:55:13 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:13 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f74b122c-b73d-4da3-9ce1-6dbf67cefa56 Jul 17 19:55:13 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:13 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75ab168a-2ac4-4899-b76b-c0f260c08535 1073741824" returned: 0 in 0.512s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:13 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c9f63c6f-6995-47b8-8503-931b275753ec tempest-CreateVolumesFromImageTest-672512528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-69905842-faa7-49c0-8f87-7ac0fc7aac36" returned: 0 in 0.357s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c9f63c6f-6995-47b8-8503-931b275753ec tempest-CreateVolumesFromImageTest-672512528 None] Lock "cinder-quobyte-69905842-faa7-49c0-8f87-7ac0fc7aac36" released by "delete_volume" :: held 0.925s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75ab168a-2ac4-4899-b76b-c0f260c08535 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:13 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75ab168a-2ac4-4899-b76b-c0f260c08535 Jul 17 19:55:13 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-c9f63c6f-6995-47b8-8503-931b275753ec tempest-CreateVolumesFromImageTest-672512528 None] Created reservations ['f50f8eae-f4ac-4817-9a0b-63b0c4d6422d', '6c6b5c79-c042-4584-a34b-f472b164db23', 'af256822-060e-40b1-881f-37b97cbf481f', '4c0468c1-d7c1-472f-9aa6-0d949e73ea9e'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c9f63c6f-6995-47b8-8503-931b275753ec tempest-CreateVolumesFromImageTest-672512528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c9f63c6f-6995-47b8-8503-931b275753ec tempest-CreateVolumesFromImageTest-672512528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c9f63c6f-6995-47b8-8503-931b275753ec tempest-CreateVolumesFromImageTest-672512528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c9f63c6f-6995-47b8-8503-931b275753ec tempest-CreateVolumesFromImageTest-672512528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c9f63c6f-6995-47b8-8503-931b275753ec tempest-CreateVolumesFromImageTest-672512528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c9f63c6f-6995-47b8-8503-931b275753ec tempest-CreateVolumesFromImageTest-672512528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:13 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:13 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c61e4ac8-cdae-41cd-9da2-6b99b0a556d0 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f74b122c-b73d-4da3-9ce1-6dbf67cefa56" returned: 0 in 0.488s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:13 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c61e4ac8-cdae-41cd-9da2-6b99b0a556d0 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f74b122c-b73d-4da3-9ce1-6dbf67cefa56 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:13 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f74b122c-b73d-4da3-9ce1-6dbf67cefa56 Jul 17 19:55:13 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:13 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-282822cc-baf7-4ffc-8dcb-51ea5895bfbb tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2565bf6d-0e97-4862-a832-fa5ae58e3f90" returned: 0 in 0.543s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-282822cc-baf7-4ffc-8dcb-51ea5895bfbb tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2565bf6d-0e97-4862-a832-fa5ae58e3f90 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:13 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2565bf6d-0e97-4862-a832-fa5ae58e3f90 Jul 17 19:55:13 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:14 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75ab168a-2ac4-4899-b76b-c0f260c08535" returned: 0 in 0.398s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.956s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1130678724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b0fdb5c-c761-471a-ae21-0f2e3103b07d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb8c854877f426fb8f1231420d1b8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:07Z,use_quota=True,user_id='3876d46298f4486c962117cdfa6a0e8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] Creating volume 3b0fdb5c-c761-471a-ae21-0f2e3103b07d {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:55:14 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3b0fdb5c-c761-471a-ae21-0f2e3103b07d 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:14 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3b0fdb5c-c761-471a-ae21-0f2e3103b07d 1073741824 Jul 17 19:55:14 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39dacc8-15c8-4b2b-b4e1-4236ea9a576d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75ab168a-2ac4-4899-b76b-c0f260c08535', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df91a53-9ffc-4a38-bca5-675534f0d847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:14 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Volume volume-75ab168a-2ac4-4899-b76b-c0f260c08535 (75ab168a-2ac4-4899-b76b-c0f260c08535): created successfully Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df91a53-9ffc-4a38-bca5-675534f0d847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:14 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Flow 'volume_create_manager' (a8def097-104d-43ba-a59f-55514bbf5d84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c9f63c6f-6995-47b8-8503-931b275753ec tempest-CreateVolumesFromImageTest-672512528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.392s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-c9f63c6f-6995-47b8-8503-931b275753ec tempest-CreateVolumesFromImageTest-672512528 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:55:14 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:14 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-c9f63c6f-6995-47b8-8503-931b275753ec tempest-CreateVolumesFromImageTest-672512528 None] Deleted volume successfully. Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c61e4ac8-cdae-41cd-9da2-6b99b0a556d0 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f74b122c-b73d-4da3-9ce1-6dbf67cefa56" returned: 0 in 0.384s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:14 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-d1b0fe15-ff40-4cac-b5f9-d1a4346c1b85 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Created volume successfully. Jul 17 19:55:14 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-282822cc-baf7-4ffc-8dcb-51ea5895bfbb tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-2565bf6d-0e97-4862-a832-fa5ae58e3f90" returned: 0 in 0.364s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c61e4ac8-cdae-41cd-9da2-6b99b0a556d0 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "cinder-quobyte-f74b122c-b73d-4da3-9ce1-6dbf67cefa56" released by "delete_volume" :: held 0.936s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-282822cc-baf7-4ffc-8dcb-51ea5895bfbb tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Lock "cinder-quobyte-2565bf6d-0e97-4862-a832-fa5ae58e3f90" released by "delete_volume" :: held 0.981s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c9f63c6f-6995-47b8-8503-931b275753ec tempest-CreateVolumesFromImageTest-672512528 None] Lock "cinder-69905842-faa7-49c0-8f87-7ac0fc7aac36-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-c61e4ac8-cdae-41cd-9da2-6b99b0a556d0 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Created reservations ['77b3f903-b569-4031-a81b-8f3baa817edb', '1cc84575-5d60-443f-958a-5f8be2e0098a', '194ea7d8-64a7-4bae-8fff-eedd05198300', '7f836c06-78bb-4cd1-aec5-ec46f6c8ce65'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-282822cc-baf7-4ffc-8dcb-51ea5895bfbb tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Created reservations ['f2c19435-bd15-421b-ab17-56379ecc26de', '635a6298-e69c-4430-b9ab-c46f83941bf5', '58a6abb6-77bb-4bb9-8ae6-ef5e0b323bb4', '74f3b438-36b4-474e-b439-01bfda417d6d'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c61e4ac8-cdae-41cd-9da2-6b99b0a556d0 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c61e4ac8-cdae-41cd-9da2-6b99b0a556d0 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c61e4ac8-cdae-41cd-9da2-6b99b0a556d0 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c61e4ac8-cdae-41cd-9da2-6b99b0a556d0 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c61e4ac8-cdae-41cd-9da2-6b99b0a556d0 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c61e4ac8-cdae-41cd-9da2-6b99b0a556d0 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:14 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:55:14 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-282822cc-baf7-4ffc-8dcb-51ea5895bfbb tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-282822cc-baf7-4ffc-8dcb-51ea5895bfbb tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-282822cc-baf7-4ffc-8dcb-51ea5895bfbb tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-282822cc-baf7-4ffc-8dcb-51ea5895bfbb tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-282822cc-baf7-4ffc-8dcb-51ea5895bfbb tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-282822cc-baf7-4ffc-8dcb-51ea5895bfbb tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:14 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:55:14 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:14 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3b0fdb5c-c761-471a-ae21-0f2e3103b07d 1073741824" returned: 0 in 0.591s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3b0fdb5c-c761-471a-ae21-0f2e3103b07d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:14 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3b0fdb5c-c761-471a-ae21-0f2e3103b07d Jul 17 19:55:14 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:14 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c61e4ac8-cdae-41cd-9da2-6b99b0a556d0 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.399s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-c61e4ac8-cdae-41cd-9da2-6b99b0a556d0 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:55:14 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-282822cc-baf7-4ffc-8dcb-51ea5895bfbb tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.345s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-282822cc-baf7-4ffc-8dcb-51ea5895bfbb tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:55:14 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-c61e4ac8-cdae-41cd-9da2-6b99b0a556d0 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Deleted volume successfully. Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c61e4ac8-cdae-41cd-9da2-6b99b0a556d0 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "cinder-f74b122c-b73d-4da3-9ce1-6dbf67cefa56-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:14 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-282822cc-baf7-4ffc-8dcb-51ea5895bfbb tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Deleted volume successfully. Jul 17 19:55:14 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-282822cc-baf7-4ffc-8dcb-51ea5895bfbb tempest-VolumeAndVolumeTypeFromImageTest-765753539 None] Lock "cinder-2565bf6d-0e97-4862-a832-fa5ae58e3f90-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:15 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3b0fdb5c-c761-471a-ae21-0f2e3103b07d" returned: 0 in 0.333s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:55:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2728fe9d-27dc-4c46-bddd-12f9dc9a18ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b0fdb5c-c761-471a-ae21-0f2e3103b07d', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0454e778-3777-43ac-a1d1-68de19dfa7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:15 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] Volume volume-3b0fdb5c-c761-471a-ae21-0f2e3103b07d (3b0fdb5c-c761-471a-ae21-0f2e3103b07d): created successfully Jul 17 19:55:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0454e778-3777-43ac-a1d1-68de19dfa7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] Flow 'volume_create_manager' (8eb6a4e6-2231-4ddb-98ba-fadb692095be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:15 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-c64909a3-0ac7-48e3-b535-c0bf9d7fa23a tempest-CreateVolumesFromSnapshotTest-1952803094 None] Created volume successfully. Jul 17 19:55:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:55:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:15 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:55:15 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:15 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6c27e231-2d9a-4d40-be85-9f90aee96c1d tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Acquiring lock "cinder-12801501-f7dd-4139-9c42-8c343098f28f-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:15 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6c27e231-2d9a-4d40-be85-9f90aee96c1d tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "cinder-12801501-f7dd-4139-9c42-8c343098f28f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:15 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6c27e231-2d9a-4d40-be85-9f90aee96c1d tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Acquiring lock "cinder-quobyte-12801501-f7dd-4139-9c42-8c343098f28f" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:15 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.322s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:15 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:55:15 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6c27e231-2d9a-4d40-be85-9f90aee96c1d tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "cinder-quobyte-12801501-f7dd-4139-9c42-8c343098f28f" acquired by "delete_volume" :: waited 0.029s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager._thread_info {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:55:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread count: 29 {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 19:55:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread info: [<_MainThread(MainThread, started 130066227544192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 19:55:15 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[83365f23-37c8-4148-b35b-b24376e8305c]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6c27e231-2d9a-4d40-be85-9f90aee96c1d tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-12801501-f7dd-4139-9c42-8c343098f28f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:15 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-12801501-f7dd-4139-9c42-8c343098f28f Jul 17 19:55:15 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-cda2c550-a780-41dc-99bf-eefcd7305c79 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "cinder-3b0fdb5c-c761-471a-ae21-0f2e3103b07d-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-cda2c550-a780-41dc-99bf-eefcd7305c79 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "cinder-3b0fdb5c-c761-471a-ae21-0f2e3103b07d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-cda2c550-a780-41dc-99bf-eefcd7305c79 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "cinder-quobyte-3b0fdb5c-c761-471a-ae21-0f2e3103b07d" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-cda2c550-a780-41dc-99bf-eefcd7305c79 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "cinder-quobyte-3b0fdb5c-c761-471a-ae21-0f2e3103b07d" acquired by "delete_volume" :: waited 0.022s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:16 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f8f343-0340-4504-a59a-25a1e962b9b3]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cda2c550-a780-41dc-99bf-eefcd7305c79 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3b0fdb5c-c761-471a-ae21-0f2e3103b07d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:16 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6c27e231-2d9a-4d40-be85-9f90aee96c1d tempest-CreateVolumesFromSourceVolumeTest-919231596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-12801501-f7dd-4139-9c42-8c343098f28f" returned: 0 in 0.509s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6c27e231-2d9a-4d40-be85-9f90aee96c1d tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-12801501-f7dd-4139-9c42-8c343098f28f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:16 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-12801501-f7dd-4139-9c42-8c343098f28f Jul 17 19:55:16 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:16 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3b0fdb5c-c761-471a-ae21-0f2e3103b07d Jul 17 19:55:16 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:16 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6c27e231-2d9a-4d40-be85-9f90aee96c1d tempest-CreateVolumesFromSourceVolumeTest-919231596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-12801501-f7dd-4139-9c42-8c343098f28f" returned: 0 in 0.341s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6c27e231-2d9a-4d40-be85-9f90aee96c1d tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "cinder-quobyte-12801501-f7dd-4139-9c42-8c343098f28f" released by "delete_volume" :: held 0.914s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:16 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cda2c550-a780-41dc-99bf-eefcd7305c79 tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3b0fdb5c-c761-471a-ae21-0f2e3103b07d" returned: 0 in 0.496s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cda2c550-a780-41dc-99bf-eefcd7305c79 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3b0fdb5c-c761-471a-ae21-0f2e3103b07d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:16 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-6c27e231-2d9a-4d40-be85-9f90aee96c1d tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Created reservations ['abc1c7d9-9e16-4504-939c-fcb89cb8affd', '5f691403-1ec8-4973-a7cd-7ce15fb3d82f', 'c9fafe8f-c8a1-4c3e-9714-c4a8797ea149', '806554e7-bbd1-4282-8d2c-378910bfb317'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:16 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3b0fdb5c-c761-471a-ae21-0f2e3103b07d Jul 17 19:55:16 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6c27e231-2d9a-4d40-be85-9f90aee96c1d tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6c27e231-2d9a-4d40-be85-9f90aee96c1d tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:16 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6c27e231-2d9a-4d40-be85-9f90aee96c1d tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:16 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6c27e231-2d9a-4d40-be85-9f90aee96c1d tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6c27e231-2d9a-4d40-be85-9f90aee96c1d tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6c27e231-2d9a-4d40-be85-9f90aee96c1d tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:16 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:55:16 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:16 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cda2c550-a780-41dc-99bf-eefcd7305c79 tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3b0fdb5c-c761-471a-ae21-0f2e3103b07d" returned: 0 in 0.309s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:17 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-cda2c550-a780-41dc-99bf-eefcd7305c79 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "cinder-quobyte-3b0fdb5c-c761-471a-ae21-0f2e3103b07d" released by "delete_volume" :: held 0.859s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:17 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-cda2c550-a780-41dc-99bf-eefcd7305c79 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Created reservations ['cee9ca17-cf30-447f-ada8-123367d21cd4', 'e1ee0a65-09e4-4657-b694-d940ac18c177', '281df50a-3898-4141-9915-7fe2a2d23f0c', 'd9443663-4a25-49ad-b7fb-ba4110c99565'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:17 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6c27e231-2d9a-4d40-be85-9f90aee96c1d tempest-CreateVolumesFromSourceVolumeTest-919231596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.323s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:17 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-6c27e231-2d9a-4d40-be85-9f90aee96c1d tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:55:17 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-6c27e231-2d9a-4d40-be85-9f90aee96c1d tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Deleted volume successfully. Jul 17 19:55:17 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-6c27e231-2d9a-4d40-be85-9f90aee96c1d tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "cinder-12801501-f7dd-4139-9c42-8c343098f28f-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cda2c550-a780-41dc-99bf-eefcd7305c79 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cda2c550-a780-41dc-99bf-eefcd7305c79 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:17 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cda2c550-a780-41dc-99bf-eefcd7305c79 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:17 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cda2c550-a780-41dc-99bf-eefcd7305c79 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cda2c550-a780-41dc-99bf-eefcd7305c79 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cda2c550-a780-41dc-99bf-eefcd7305c79 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:17 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:55:17 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:17 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cda2c550-a780-41dc-99bf-eefcd7305c79 tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.272s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:17 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-cda2c550-a780-41dc-99bf-eefcd7305c79 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:55:17 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-cda2c550-a780-41dc-99bf-eefcd7305c79 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Deleted volume successfully. Jul 17 19:55:17 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-cda2c550-a780-41dc-99bf-eefcd7305c79 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "cinder-3b0fdb5c-c761-471a-ae21-0f2e3103b07d-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:17 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-b07f7715-da3e-4ec9-823b-fd4f64a166a9 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Acquiring lock "cinder-50e1558d-0d76-4d26-93cb-e2faf530ea5a-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:17 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-b07f7715-da3e-4ec9-823b-fd4f64a166a9 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "cinder-50e1558d-0d76-4d26-93cb-e2faf530ea5a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:17 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-b07f7715-da3e-4ec9-823b-fd4f64a166a9 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Acquiring lock "cinder-quobyte-50e1558d-0d76-4d26-93cb-e2faf530ea5a" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:17 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-b07f7715-da3e-4ec9-823b-fd4f64a166a9 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "cinder-quobyte-50e1558d-0d76-4d26-93cb-e2faf530ea5a" acquired by "delete_volume" :: waited 0.014s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:17 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0930db-462e-4026-baf0-9ecd53071112]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b07f7715-da3e-4ec9-823b-fd4f64a166a9 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-50e1558d-0d76-4d26-93cb-e2faf530ea5a {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:18 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-50e1558d-0d76-4d26-93cb-e2faf530ea5a Jul 17 19:55:18 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:18 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9a4b5576-57fe-41ce-9fe7-30724aeef5d4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "cinder-75ab168a-2ac4-4899-b76b-c0f260c08535-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:18 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9a4b5576-57fe-41ce-9fe7-30724aeef5d4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "cinder-75ab168a-2ac4-4899-b76b-c0f260c08535-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:18 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9a4b5576-57fe-41ce-9fe7-30724aeef5d4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "cinder-quobyte-75ab168a-2ac4-4899-b76b-c0f260c08535" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:18 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9a4b5576-57fe-41ce-9fe7-30724aeef5d4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "cinder-quobyte-75ab168a-2ac4-4899-b76b-c0f260c08535" acquired by "delete_volume" :: waited 0.019s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:18 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b07f7715-da3e-4ec9-823b-fd4f64a166a9 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-50e1558d-0d76-4d26-93cb-e2faf530ea5a" returned: 0 in 0.514s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b07f7715-da3e-4ec9-823b-fd4f64a166a9 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-50e1558d-0d76-4d26-93cb-e2faf530ea5a {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:18 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7cccff-65cc-41b9-91db-d29c51f63916]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9a4b5576-57fe-41ce-9fe7-30724aeef5d4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75ab168a-2ac4-4899-b76b-c0f260c08535 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:18 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-50e1558d-0d76-4d26-93cb-e2faf530ea5a Jul 17 19:55:18 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:18 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75ab168a-2ac4-4899-b76b-c0f260c08535 Jul 17 19:55:18 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:18 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b07f7715-da3e-4ec9-823b-fd4f64a166a9 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-50e1558d-0d76-4d26-93cb-e2faf530ea5a" returned: 0 in 0.310s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:18 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-b07f7715-da3e-4ec9-823b-fd4f64a166a9 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "cinder-quobyte-50e1558d-0d76-4d26-93cb-e2faf530ea5a" released by "delete_volume" :: held 0.867s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:18 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-b07f7715-da3e-4ec9-823b-fd4f64a166a9 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Created reservations ['ca0fbb55-886f-4df0-ac4c-40605d87539f', 'f40ed476-8cd1-4613-aa43-2e1366fa414f', '7df93427-f392-4c6e-9da8-fb9fe27e0b10', 'fb3e272c-3411-47f3-95c4-b3710ec55b86'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:18 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b07f7715-da3e-4ec9-823b-fd4f64a166a9 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b07f7715-da3e-4ec9-823b-fd4f64a166a9 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:18 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b07f7715-da3e-4ec9-823b-fd4f64a166a9 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:19 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b07f7715-da3e-4ec9-823b-fd4f64a166a9 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b07f7715-da3e-4ec9-823b-fd4f64a166a9 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b07f7715-da3e-4ec9-823b-fd4f64a166a9 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9a4b5576-57fe-41ce-9fe7-30724aeef5d4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75ab168a-2ac4-4899-b76b-c0f260c08535" returned: 0 in 0.507s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9a4b5576-57fe-41ce-9fe7-30724aeef5d4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75ab168a-2ac4-4899-b76b-c0f260c08535 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:19 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:55:19 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:19 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75ab168a-2ac4-4899-b76b-c0f260c08535 Jul 17 19:55:19 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:19 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c3c00fb0-e41b-4ffc-8f29-7fe5649b1962 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Acquiring lock "cinder-a6bb8532-e5a7-441a-8cce-0609b2f09eda-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:19 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c3c00fb0-e41b-4ffc-8f29-7fe5649b1962 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "cinder-a6bb8532-e5a7-441a-8cce-0609b2f09eda-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:19 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c3c00fb0-e41b-4ffc-8f29-7fe5649b1962 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Acquiring lock "cinder-quobyte-a6bb8532-e5a7-441a-8cce-0609b2f09eda" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:19 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c3c00fb0-e41b-4ffc-8f29-7fe5649b1962 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "cinder-quobyte-a6bb8532-e5a7-441a-8cce-0609b2f09eda" acquired by "delete_volume" :: waited 0.021s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:19 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[019245f6-35bf-48e0-a1e2-fe16747c8f29]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c3c00fb0-e41b-4ffc-8f29-7fe5649b1962 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a6bb8532-e5a7-441a-8cce-0609b2f09eda {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:19 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b07f7715-da3e-4ec9-823b-fd4f64a166a9 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.341s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:19 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-b07f7715-da3e-4ec9-823b-fd4f64a166a9 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:55:19 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-b07f7715-da3e-4ec9-823b-fd4f64a166a9 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Deleted volume successfully. Jul 17 19:55:19 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9a4b5576-57fe-41ce-9fe7-30724aeef5d4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-75ab168a-2ac4-4899-b76b-c0f260c08535" returned: 0 in 0.364s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:19 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9a4b5576-57fe-41ce-9fe7-30724aeef5d4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "cinder-quobyte-75ab168a-2ac4-4899-b76b-c0f260c08535" released by "delete_volume" :: held 0.947s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:19 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-b07f7715-da3e-4ec9-823b-fd4f64a166a9 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "cinder-50e1558d-0d76-4d26-93cb-e2faf530ea5a-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:19 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a6bb8532-e5a7-441a-8cce-0609b2f09eda Jul 17 19:55:19 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:19 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-9a4b5576-57fe-41ce-9fe7-30724aeef5d4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Created reservations ['d2f81c44-a68c-45f6-ae01-42adca5c0525', '53382aef-ab2d-4ad7-a21f-f03b13ef9faa', '5a5cb12a-6d96-42e9-a2a4-b7abe06d14e6', 'eea01468-8b07-497e-a2fa-6b146df9c6fd'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9a4b5576-57fe-41ce-9fe7-30724aeef5d4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9a4b5576-57fe-41ce-9fe7-30724aeef5d4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:19 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9a4b5576-57fe-41ce-9fe7-30724aeef5d4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:19 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9a4b5576-57fe-41ce-9fe7-30724aeef5d4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9a4b5576-57fe-41ce-9fe7-30724aeef5d4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9a4b5576-57fe-41ce-9fe7-30724aeef5d4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:19 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:55:19 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:19 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c3c00fb0-e41b-4ffc-8f29-7fe5649b1962 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a6bb8532-e5a7-441a-8cce-0609b2f09eda" returned: 0 in 0.556s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c3c00fb0-e41b-4ffc-8f29-7fe5649b1962 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a6bb8532-e5a7-441a-8cce-0609b2f09eda {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:19 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a6bb8532-e5a7-441a-8cce-0609b2f09eda Jul 17 19:55:19 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:19 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9a4b5576-57fe-41ce-9fe7-30724aeef5d4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.295s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:19 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-9a4b5576-57fe-41ce-9fe7-30724aeef5d4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:55:19 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-9a4b5576-57fe-41ce-9fe7-30724aeef5d4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Deleted volume successfully. Jul 17 19:55:19 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9a4b5576-57fe-41ce-9fe7-30724aeef5d4 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "cinder-75ab168a-2ac4-4899-b76b-c0f260c08535-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:20 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c3c00fb0-e41b-4ffc-8f29-7fe5649b1962 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-a6bb8532-e5a7-441a-8cce-0609b2f09eda" returned: 0 in 0.321s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:20 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c3c00fb0-e41b-4ffc-8f29-7fe5649b1962 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "cinder-quobyte-a6bb8532-e5a7-441a-8cce-0609b2f09eda" released by "delete_volume" :: held 0.937s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:20 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-c3c00fb0-e41b-4ffc-8f29-7fe5649b1962 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Created reservations ['793d0a3b-a004-448c-9e2b-693a72a9d5c8', '24388fba-070a-43a8-9e34-e3dcd908445d', '26b5088d-0d70-4f40-88b3-a80cda0c4165', '7d43c291-4a87-4e9a-8eb4-e5737c4a3448'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c3c00fb0-e41b-4ffc-8f29-7fe5649b1962 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c3c00fb0-e41b-4ffc-8f29-7fe5649b1962 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:20 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c3c00fb0-e41b-4ffc-8f29-7fe5649b1962 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:20 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c3c00fb0-e41b-4ffc-8f29-7fe5649b1962 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c3c00fb0-e41b-4ffc-8f29-7fe5649b1962 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c3c00fb0-e41b-4ffc-8f29-7fe5649b1962 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:20 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:55:20 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:20 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c3c00fb0-e41b-4ffc-8f29-7fe5649b1962 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.267s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:20 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-c3c00fb0-e41b-4ffc-8f29-7fe5649b1962 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:55:20 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-c3c00fb0-e41b-4ffc-8f29-7fe5649b1962 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Deleted volume successfully. Jul 17 19:55:20 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c3c00fb0-e41b-4ffc-8f29-7fe5649b1962 tempest-CreateVolumesFromSourceVolumeTest-919231596 None] Lock "cinder-a6bb8532-e5a7-441a-8cce-0609b2f09eda-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:20 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0b79d33c-1302-41f5-9dfc-7277a70736c7 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "cinder-259a4b3f-4159-4190-b29c-025e657770b2-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:20 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0b79d33c-1302-41f5-9dfc-7277a70736c7 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "cinder-259a4b3f-4159-4190-b29c-025e657770b2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:20 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:55:20 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Flow 'volume_create_manager' (0fc57ad3-e3a3-4e55-aaa2-e7c569e79fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:20 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a669bb70-3224-49e5-a9fd-30aca82633b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:20 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a669bb70-3224-49e5-a9fd-30aca82633b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95e9aa1b-e398-4617-a038-36e786610024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a793bdff0bf473e9e911edb3a7ac3b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:21Z,use_quota=True,user_id='05182944a8064fb8862c9ec8780ca1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:20 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8fe7261-a81a-428c-b457-0d7c2d5eaceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:20 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8fe7261-a81a-428c-b457-0d7c2d5eaceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:20 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0665b027-94f3-4161-90a9-4e9d530e0fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:20 devstack cinder-volume[87726]: DEBUG cinder.image.glance [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Creating Keystone auth plugin from conf {{(pid=87726) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0b79d33c-1302-41f5-9dfc-7277a70736c7 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "cinder-quobyte-259a4b3f-4159-4190-b29c-025e657770b2" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0b79d33c-1302-41f5-9dfc-7277a70736c7 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "cinder-quobyte-259a4b3f-4159-4190-b29c-025e657770b2" acquired by "delete_volume" :: waited 0.019s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[089bd8da-e232-4c23-a56d-76e16a1fdc62]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0b79d33c-1302-41f5-9dfc-7277a70736c7 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-259a4b3f-4159-4190-b29c-025e657770b2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:21 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-259a4b3f-4159-4190-b29c-025e657770b2 Jul 17 19:55:21 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] Flow 'volume_create_manager' (9644da80-f0e4-4a1c-aa0c-bbb7368ea7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5041b9a8-baf2-4ec4-aa23-b3e4b4ea784e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5041b9a8-baf2-4ec4-aa23-b3e4b4ea784e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c18382d-138f-41da-ac73-4bd560588c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c050fe6fc346b3bed852a03a10ec4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:21Z,use_quota=True,user_id='e22efd8703824e05960fe690fe9c5be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df240858-7889-4552-9f21-cc1ad3ccc825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df240858-7889-4552-9f21-cc1ad3ccc825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e6c590-f8a4-4bad-b053-a73ce570b899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e6c590-f8a4-4bad-b053-a73ce570b899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c18382d-138f-41da-ac73-4bd560588c02', 'volume_name': 'volume-7c18382d-138f-41da-ac73-4bd560588c02', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e071d36b-d4ce-4c78-8063-b60f73c80afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e071d36b-d4ce-4c78-8063-b60f73c80afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bed5b31-8b8a-4961-a3e2-56d62afc6367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:21 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] Volume 7c18382d-138f-41da-ac73-4bd560588c02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c18382d-138f-41da-ac73-4bd560588c02', 'volume_size': 1} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c18382d-138f-41da-ac73-4bd560588c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c050fe6fc346b3bed852a03a10ec4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:21Z,use_quota=True,user_id='e22efd8703824e05960fe690fe9c5be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] Creating volume 7c18382d-138f-41da-ac73-4bd560588c02 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:55:21 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7c18382d-138f-41da-ac73-4bd560588c02 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:21 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7c18382d-138f-41da-ac73-4bd560588c02 1073741824 Jul 17 19:55:21 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0665b027-94f3-4161-90a9-4e9d530e0fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '95e9aa1b-e398-4617-a038-36e786610024', 'volume_name': 'volume-95e9aa1b-e398-4617-a038-36e786610024', 'volume_size': 1, 'image_id': '75754200-7cad-48b0-8f79-36bd3ba6f0db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/75754200-7cad-48b0-8f79-36bd3ba6f0db', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a739b829ef5c7c602ef182f06e37097b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9a793bdff0bf473e9e911edb3a7ac3b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '77c0913433f0bc3d9d94b18418ccb971e49ca92d5fa6bae558806897fcf6fb7a74b64d7a6051874ef77c057f288560b73235d8f2c34dea9fb78c218276476c76', 'id': '75754200-7cad-48b0-8f79-36bd3ba6f0db', 'created_at': datetime.datetime(2026, 7, 17, 17, 55, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 17, 55, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/75754200-7cad-48b0-8f79-36bd3ba6f0db/file', 'properties': {}}, 'image_service': }' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd00bfab-93ff-45d6-ab43-05b9d1faa878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd00bfab-93ff-45d6-ab43-05b9d1faa878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a98181e-4a60-40c9-aa34-6951e6f2b103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:21 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Volume 95e9aa1b-e398-4617-a038-36e786610024: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-95e9aa1b-e398-4617-a038-36e786610024', 'volume_size': 1, 'image_id': '75754200-7cad-48b0-8f79-36bd3ba6f0db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/75754200-7cad-48b0-8f79-36bd3ba6f0db', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a739b829ef5c7c602ef182f06e37097b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9a793bdff0bf473e9e911edb3a7ac3b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '77c0913433f0bc3d9d94b18418ccb971e49ca92d5fa6bae558806897fcf6fb7a74b64d7a6051874ef77c057f288560b73235d8f2c34dea9fb78c218276476c76', 'id': '75754200-7cad-48b0-8f79-36bd3ba6f0db', 'created_at': datetime.datetime(2026, 7, 17, 17, 55, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 17, 55, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/75754200-7cad-48b0-8f79-36bd3ba6f0db/file', 'properties': {}}, 'image_service': } Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Trying to clone 95e9aa1b-e398-4617-a038-36e786610024 from image 75754200-7cad-48b0-8f79-36bd3ba6f0db at location (None, [{'url': 'file:///opt/stack/data/glance/images/75754200-7cad-48b0-8f79-36bd3ba6f0db', 'metadata': {}}]). {{(pid=87726) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 19:55:21 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0b79d33c-1302-41f5-9dfc-7277a70736c7 tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-259a4b3f-4159-4190-b29c-025e657770b2" returned: 0 in 0.538s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0b79d33c-1302-41f5-9dfc-7277a70736c7 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-259a4b3f-4159-4190-b29c-025e657770b2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_75754200-7cad-48b0-8f79-36bd3ba6f0db_093a4aiadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87726) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 19:55:21 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Image download 0.00 MB at 0.00 MB/s Jul 17 19:55:21 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-259a4b3f-4159-4190-b29c-025e657770b2 Jul 17 19:55:21 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[d725b59a-b83b-4ed3-b1c3-273a4a1ded73]: (4, 'raw') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75754200-7cad-48b0-8f79-36bd3ba6f0db_093a4aiadevstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:21 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75754200-7cad-48b0-8f79-36bd3ba6f0db_093a4aiadevstack@QuobyteHD Jul 17 19:55:21 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:21 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0b79d33c-1302-41f5-9dfc-7277a70736c7 tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-259a4b3f-4159-4190-b29c-025e657770b2" returned: 0 in 0.313s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0b79d33c-1302-41f5-9dfc-7277a70736c7 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "cinder-quobyte-259a4b3f-4159-4190-b29c-025e657770b2" released by "delete_volume" :: held 0.927s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:21 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7c18382d-138f-41da-ac73-4bd560588c02 1073741824" returned: 0 in 0.541s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7c18382d-138f-41da-ac73-4bd560588c02 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:22 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-0b79d33c-1302-41f5-9dfc-7277a70736c7 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Created reservations ['df76e9b9-6506-432f-8f10-caac6131fc31', '094a3bee-35c8-4c95-bd1b-4eba6b67a629', '8afc8f43-846f-4f56-9be9-da485fd52e49', 'dbe55e27-07bc-4b03-b0eb-64acaaccf2da'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:22 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7c18382d-138f-41da-ac73-4bd560588c02 Jul 17 19:55:22 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:22 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75754200-7cad-48b0-8f79-36bd3ba6f0db_093a4aiadevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75754200-7cad-48b0-8f79-36bd3ba6f0db_093a4aiadevstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0b79d33c-1302-41f5-9dfc-7277a70736c7 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0b79d33c-1302-41f5-9dfc-7277a70736c7 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0b79d33c-1302-41f5-9dfc-7277a70736c7 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0b79d33c-1302-41f5-9dfc-7277a70736c7 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0b79d33c-1302-41f5-9dfc-7277a70736c7 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0b79d33c-1302-41f5-9dfc-7277a70736c7 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:22 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:55:22 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:22 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75754200-7cad-48b0-8f79-36bd3ba6f0db_093a4aiadevstack@QuobyteHD Jul 17 19:55:22 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:22 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7c18382d-138f-41da-ac73-4bd560588c02" returned: 0 in 0.337s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:55:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bed5b31-8b8a-4961-a3e2-56d62afc6367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c18382d-138f-41da-ac73-4bd560588c02', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f824c104-f064-4b44-9993-34265189ca52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:22 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] Volume volume-7c18382d-138f-41da-ac73-4bd560588c02 (7c18382d-138f-41da-ac73-4bd560588c02): created successfully Jul 17 19:55:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f824c104-f064-4b44-9993-34265189ca52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:22 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] Flow 'volume_create_manager' (9644da80-f0e4-4a1c-aa0c-bbb7368ea7cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:22 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-5f04d1e3-e3e8-460f-a2e0-a479199b0d01 tempest-CinderUnicodeTest-252967878 None] Created volume successfully. Jul 17 19:55:22 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0b79d33c-1302-41f5-9dfc-7277a70736c7 tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.351s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:22 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-0b79d33c-1302-41f5-9dfc-7277a70736c7 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:55:22 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-0b79d33c-1302-41f5-9dfc-7277a70736c7 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Deleted volume successfully. Jul 17 19:55:22 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75754200-7cad-48b0-8f79-36bd3ba6f0db_093a4aiadevstack@QuobyteHD" returned: 1 in 0.451s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75754200-7cad-48b0-8f79-36bd3ba6f0db_093a4aiadevstack@QuobyteHD' failed. Not Retrying. {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 19:55:22 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Temporary image 75754200-7cad-48b0-8f79-36bd3ba6f0db is fetched for user 05182944a8064fb8862c9ec8780ca1d5. {{(pid=87726) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 19:55:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0b79d33c-1302-41f5-9dfc-7277a70736c7 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "cinder-259a4b3f-4159-4190-b29c-025e657770b2-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:22 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[5785f663-a5a0-492d-9110-30173e20dcf3]: (4, 'raw') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75754200-7cad-48b0-8f79-36bd3ba6f0db_093a4aiadevstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:22 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75754200-7cad-48b0-8f79-36bd3ba6f0db_093a4aiadevstack@QuobyteHD Jul 17 19:55:22 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:23 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75754200-7cad-48b0-8f79-36bd3ba6f0db_093a4aiadevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75754200-7cad-48b0-8f79-36bd3ba6f0db_093a4aiadevstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:23 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75754200-7cad-48b0-8f79-36bd3ba6f0db_093a4aiadevstack@QuobyteHD Jul 17 19:55:23 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-28720b45-e068-4651-b70d-d83b5214679e tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "cinder-d2894991-2cbc-4c8e-9843-2c1c38b0d1b5-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-28720b45-e068-4651-b70d-d83b5214679e tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "cinder-d2894991-2cbc-4c8e-9843-2c1c38b0d1b5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-28720b45-e068-4651-b70d-d83b5214679e tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "cinder-quobyte-d2894991-2cbc-4c8e-9843-2c1c38b0d1b5" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:23 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-28720b45-e068-4651-b70d-d83b5214679e tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "cinder-quobyte-d2894991-2cbc-4c8e-9843-2c1c38b0d1b5" acquired by "delete_volume" :: waited 0.027s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:23 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd2cbb9-59f3-41b3-bc3e-58013f94c2c4]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-28720b45-e068-4651-b70d-d83b5214679e tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d2894991-2cbc-4c8e-9843-2c1c38b0d1b5 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:23 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75754200-7cad-48b0-8f79-36bd3ba6f0db_093a4aiadevstack@QuobyteHD" returned: 1 in 0.371s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75754200-7cad-48b0-8f79-36bd3ba6f0db_093a4aiadevstack@QuobyteHD' failed. Not Retrying. {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 19:55:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95e9aa1b-e398-4617-a038-36e786610024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a793bdff0bf473e9e911edb3a7ac3b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:21Z,use_quota=True,user_id='05182944a8064fb8862c9ec8780ca1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:55:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Creating volume 95e9aa1b-e398-4617-a038-36e786610024 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:55:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:55:23 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:55:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-95e9aa1b-e398-4617-a038-36e786610024 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:23 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-95e9aa1b-e398-4617-a038-36e786610024 1073741824 Jul 17 19:55:23 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:23 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d2894991-2cbc-4c8e-9843-2c1c38b0d1b5 Jul 17 19:55:23 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:23 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-28720b45-e068-4651-b70d-d83b5214679e tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d2894991-2cbc-4c8e-9843-2c1c38b0d1b5" returned: 0 in 0.490s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-28720b45-e068-4651-b70d-d83b5214679e tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d2894991-2cbc-4c8e-9843-2c1c38b0d1b5 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:23 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d2894991-2cbc-4c8e-9843-2c1c38b0d1b5 Jul 17 19:55:23 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:23 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-95e9aa1b-e398-4617-a038-36e786610024 1073741824" returned: 0 in 0.559s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-95e9aa1b-e398-4617-a038-36e786610024 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:24 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-95e9aa1b-e398-4617-a038-36e786610024 Jul 17 19:55:24 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] Flow 'volume_create_manager' (cc73cf6c-41ec-4477-a64a-f2d7b645ee15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (854d0961-caf0-4e19-9bd1-292911c47ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (854d0961-caf0-4e19-9bd1-292911c47ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-623944169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=401060ac-f32b-4f23-9279-b23cf59f5272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c050fe6fc346b3bed852a03a10ec4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:24Z,use_quota=True,user_id='e22efd8703824e05960fe690fe9c5be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:24 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab47a42f-bf2b-47db-8f6f-aecf3dce847d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab47a42f-bf2b-47db-8f6f-aecf3dce847d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92fea6e3-ea2d-4da3-873a-8adb3a61f257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92fea6e3-ea2d-4da3-873a-8adb3a61f257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '401060ac-f32b-4f23-9279-b23cf59f5272', 'volume_name': 'volume-401060ac-f32b-4f23-9279-b23cf59f5272', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4221fe5c-33d4-4ae2-9718-a2dee965a860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4221fe5c-33d4-4ae2-9718-a2dee965a860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (453a70af-1494-49b2-a371-4f3383550058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:24 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] Volume 401060ac-f32b-4f23-9279-b23cf59f5272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-401060ac-f32b-4f23-9279-b23cf59f5272', 'volume_size': 1} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-28720b45-e068-4651-b70d-d83b5214679e tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-d2894991-2cbc-4c8e-9843-2c1c38b0d1b5" returned: 0 in 0.407s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-28720b45-e068-4651-b70d-d83b5214679e tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "cinder-quobyte-d2894991-2cbc-4c8e-9843-2c1c38b0d1b5" released by "delete_volume" :: held 0.949s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-28720b45-e068-4651-b70d-d83b5214679e tempest-CreateVolumesFromSnapshotTest-1952803094 None] Created reservations ['8a7a6b98-ba49-4675-8c07-d3b17e9236c3', 'c68aade1-6e6b-433b-9b5d-7895dd1e6466', 'eb05ec3f-82cf-4ca9-a0f2-73757cf2b992', 'fc2b4a31-f509-49a6-a696-8935e6642c5a'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:24 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-95e9aa1b-e398-4617-a038-36e786610024" returned: 0 in 0.336s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.128s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-623944169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=401060ac-f32b-4f23-9279-b23cf59f5272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c050fe6fc346b3bed852a03a10ec4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:24Z,use_quota=True,user_id='e22efd8703824e05960fe690fe9c5be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] Creating volume 401060ac-f32b-4f23-9279-b23cf59f5272 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:55:24 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:24 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272 1073741824 Jul 17 19:55:24 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG cinder.volume.volume_utils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Attempting download of 75754200-7cad-48b0-8f79-36bd3ba6f0db ((None, [{'url': 'file:///opt/stack/data/glance/images/75754200-7cad-48b0-8f79-36bd3ba6f0db', 'metadata': {}}])) to volume 95e9aa1b-e398-4617-a038-36e786610024. {{(pid=87726) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-28720b45-e068-4651-b70d-d83b5214679e tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-28720b45-e068-4651-b70d-d83b5214679e tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-28720b45-e068-4651-b70d-d83b5214679e tempest-CreateVolumesFromSnapshotTest-1952803094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-28720b45-e068-4651-b70d-d83b5214679e tempest-CreateVolumesFromSnapshotTest-1952803094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-28720b45-e068-4651-b70d-d83b5214679e tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-28720b45-e068-4651-b70d-d83b5214679e tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:24 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:55:24 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed3edf0-c043-42fa-a22e-6126b559c393]: (4, 'raw') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_75754200-7cad-48b0-8f79-36bd3ba6f0db_8abym3uz {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:24 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_75754200-7cad-48b0-8f79-36bd3ba6f0db_8abym3uz Jul 17 19:55:24 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:24 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-28720b45-e068-4651-b70d-d83b5214679e tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.293s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-28720b45-e068-4651-b70d-d83b5214679e tempest-CreateVolumesFromSnapshotTest-1952803094 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:55:24 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-28720b45-e068-4651-b70d-d83b5214679e tempest-CreateVolumesFromSnapshotTest-1952803094 None] Deleted volume successfully. Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-28720b45-e068-4651-b70d-d83b5214679e tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "cinder-d2894991-2cbc-4c8e-9843-2c1c38b0d1b5-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:24 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272 1073741824" returned: 0 in 0.477s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:24 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272 Jul 17 19:55:24 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:24 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_75754200-7cad-48b0-8f79-36bd3ba6f0db_8abym3uz" returned: 0 in 0.442s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75754200-7cad-48b0-8f79-36bd3ba6f0db_8abym3uz {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:25 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75754200-7cad-48b0-8f79-36bd3ba6f0db_8abym3uz Jul 17 19:55:25 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:25 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272" returned: 0 in 0.306s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:55:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (453a70af-1494-49b2-a371-4f3383550058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-401060ac-f32b-4f23-9279-b23cf59f5272', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f26f42b0-f2bf-459d-8e76-2bd1c0d34874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:25 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] Volume volume-401060ac-f32b-4f23-9279-b23cf59f5272 (401060ac-f32b-4f23-9279-b23cf59f5272): created successfully Jul 17 19:55:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f26f42b0-f2bf-459d-8e76-2bd1c0d34874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:25 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] Flow 'volume_create_manager' (cc73cf6c-41ec-4477-a64a-f2d7b645ee15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:25 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-b6102745-e68b-4f9b-8a68-4920cead9378 tempest-CinderUnicodeTest-252967878 None] Created volume successfully. Jul 17 19:55:25 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75754200-7cad-48b0-8f79-36bd3ba6f0db_8abym3uz" returned: 1 in 0.370s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75754200-7cad-48b0-8f79-36bd3ba6f0db_8abym3uz' failed. Not Retrying. {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 19:55:25 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[6178c46b-b320-40bd-862d-14934f51aba7]: (4, 'raw') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75754200-7cad-48b0-8f79-36bd3ba6f0db_093a4aiadevstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:25 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75754200-7cad-48b0-8f79-36bd3ba6f0db_093a4aiadevstack@QuobyteHD Jul 17 19:55:25 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:25 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5bf0c314-5079-4f78-9108-0b206efe1729 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "cinder-00954b0e-af6a-4907-81a2-443a796cec13-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:25 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5bf0c314-5079-4f78-9108-0b206efe1729 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "cinder-00954b0e-af6a-4907-81a2-443a796cec13-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:25 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5bf0c314-5079-4f78-9108-0b206efe1729 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "cinder-quobyte-00954b0e-af6a-4907-81a2-443a796cec13" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:25 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5bf0c314-5079-4f78-9108-0b206efe1729 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "cinder-quobyte-00954b0e-af6a-4907-81a2-443a796cec13" acquired by "delete_volume" :: waited 0.016s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:25 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cda3918-e119-4708-8047-dbd56bdb071b]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5bf0c314-5079-4f78-9108-0b206efe1729 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-00954b0e-af6a-4907-81a2-443a796cec13 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:25 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75754200-7cad-48b0-8f79-36bd3ba6f0db_093a4aiadevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75754200-7cad-48b0-8f79-36bd3ba6f0db_093a4aiadevstack@QuobyteHD {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:25 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-00954b0e-af6a-4907-81a2-443a796cec13 Jul 17 19:55:25 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:25 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75754200-7cad-48b0-8f79-36bd3ba6f0db_093a4aiadevstack@QuobyteHD Jul 17 19:55:25 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:26 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5bf0c314-5079-4f78-9108-0b206efe1729 tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-00954b0e-af6a-4907-81a2-443a796cec13" returned: 0 in 0.425s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5bf0c314-5079-4f78-9108-0b206efe1729 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-00954b0e-af6a-4907-81a2-443a796cec13 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:26 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-00954b0e-af6a-4907-81a2-443a796cec13 Jul 17 19:55:26 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:26 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75754200-7cad-48b0-8f79-36bd3ba6f0db_093a4aiadevstack@QuobyteHD" returned: 1 in 0.373s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75754200-7cad-48b0-8f79-36bd3ba6f0db_093a4aiadevstack@QuobyteHD' failed. Not Retrying. {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] 75754200-7cad-48b0-8f79-36bd3ba6f0db was raw, converting to qcow2 {{(pid=87726) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_75754200-7cad-48b0-8f79-36bd3ba6f0db_093a4aiadevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-95e9aa1b-e398-4617-a038-36e786610024 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:26 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_75754200-7cad-48b0-8f79-36bd3ba6f0db_093a4aiadevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-95e9aa1b-e398-4617-a038-36e786610024 Jul 17 19:55:26 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:26 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5bf0c314-5079-4f78-9108-0b206efe1729 tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-00954b0e-af6a-4907-81a2-443a796cec13" returned: 0 in 0.354s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5bf0c314-5079-4f78-9108-0b206efe1729 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "cinder-quobyte-00954b0e-af6a-4907-81a2-443a796cec13" released by "delete_volume" :: held 0.841s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e4a24522-cd93-47e2-9751-c6523517776f tempest-CinderUnicodeTest-252967878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e4a24522-cd93-47e2-9751-c6523517776f tempest-CinderUnicodeTest-252967878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-e4a24522-cd93-47e2-9751-c6523517776f tempest-CinderUnicodeTest-252967878 None] Creating offline snapshot 3f0068bb-ac11-4128-aee7-5f22b59b976d of volume 401060ac-f32b-4f23-9279-b23cf59f5272 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcea6659-6af6-4e9b-9856-a9635232041d]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e4a24522-cd93-47e2-9751-c6523517776f tempest-CinderUnicodeTest-252967878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-5bf0c314-5079-4f78-9108-0b206efe1729 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Created reservations ['6bc9872d-b3e9-436c-ad53-4615dc1c9db3', 'dfaa11c3-34b1-42b5-8173-fe52e431a7b4', 'de0f7be0-9a76-4255-9713-9070e7ed4125', '3daf76fc-a867-448b-9d06-976d8578e887'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5bf0c314-5079-4f78-9108-0b206efe1729 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5bf0c314-5079-4f78-9108-0b206efe1729 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5bf0c314-5079-4f78-9108-0b206efe1729 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5bf0c314-5079-4f78-9108-0b206efe1729 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5bf0c314-5079-4f78-9108-0b206efe1729 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5bf0c314-5079-4f78-9108-0b206efe1729 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:26 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:55:26 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:26 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272 Jul 17 19:55:26 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-4d217e5a-9480-4daa-831a-a89037e6a239 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "cinder-152b5808-8ff0-4553-98df-81c2b026b667-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:26 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_75754200-7cad-48b0-8f79-36bd3ba6f0db_093a4aiadevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-95e9aa1b-e398-4617-a038-36e786610024" returned: 0 in 0.639s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_75754200-7cad-48b0-8f79-36bd3ba6f0db_093a4aiadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-95e9aa1b-e398-4617-a038-36e786610024 {{(pid=87726) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 19:55:26 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Converted 0.00 MB image at 0.00 MB/s Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-95e9aa1b-e398-4617-a038-36e786610024 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-4d217e5a-9480-4daa-831a-a89037e6a239 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "cinder-152b5808-8ff0-4553-98df-81c2b026b667-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-4d217e5a-9480-4daa-831a-a89037e6a239 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "cinder-quobyte-56140e7c-7018-4b31-aadb-a2886a29553c" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:26 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-95e9aa1b-e398-4617-a038-36e786610024 1G Jul 17 19:55:26 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-4d217e5a-9480-4daa-831a-a89037e6a239 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "cinder-quobyte-56140e7c-7018-4b31-aadb-a2886a29553c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-4d217e5a-9480-4daa-831a-a89037e6a239 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "cinder-quobyte-152b5808-8ff0-4553-98df-81c2b026b667" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-4d217e5a-9480-4daa-831a-a89037e6a239 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "cinder-quobyte-152b5808-8ff0-4553-98df-81c2b026b667" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-4d217e5a-9480-4daa-831a-a89037e6a239 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Deleting offline snapshot 152b5808-8ff0-4553-98df-81c2b026b667 of volume 56140e7c-7018-4b31-aadb-a2886a29553c {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-4d217e5a-9480-4daa-831a-a89037e6a239 tempest-CreateVolumesFromSnapshotTest-1952803094 None] snapshot_file for this snap is: volume-56140e7c-7018-4b31-aadb-a2886a29553c.152b5808-8ff0-4553-98df-81c2b026b667 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[5278d449-6425-4b14-9d89-20ccaa0c3fcb]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4d217e5a-9480-4daa-831a-a89037e6a239 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c.152b5808-8ff0-4553-98df-81c2b026b667 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:26 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5bf0c314-5079-4f78-9108-0b206efe1729 tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.384s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-5bf0c314-5079-4f78-9108-0b206efe1729 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:55:26 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-5bf0c314-5079-4f78-9108-0b206efe1729 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Deleted volume successfully. Jul 17 19:55:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5bf0c314-5079-4f78-9108-0b206efe1729 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "cinder-00954b0e-af6a-4907-81a2-443a796cec13-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:26 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e4a24522-cd93-47e2-9751-c6523517776f tempest-CinderUnicodeTest-252967878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272" returned: 0 in 0.536s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e4a24522-cd93-47e2-9751-c6523517776f tempest-CinderUnicodeTest-252967878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272.3f0068bb-ac11-4128-aee7-5f22b59b976d 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:27 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272.3f0068bb-ac11-4128-aee7-5f22b59b976d 1G Jul 17 19:55:27 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:27 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c.152b5808-8ff0-4553-98df-81c2b026b667 Jul 17 19:55:27 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:27 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-95e9aa1b-e398-4617-a038-36e786610024 1G" returned: 0 in 0.471s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:27 devstack cinder-volume[87726]: DEBUG cinder.volume.volume_utils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Downloaded image 75754200-7cad-48b0-8f79-36bd3ba6f0db ((None, [{'url': 'file:///opt/stack/data/glance/images/75754200-7cad-48b0-8f79-36bd3ba6f0db', 'metadata': {}}])) to volume 95e9aa1b-e398-4617-a038-36e786610024 successfully. {{(pid=87726) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 19:55:27 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Temporary image 75754200-7cad-48b0-8f79-36bd3ba6f0db for user 05182944a8064fb8862c9ec8780ca1d5 is deleted. {{(pid=87726) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 19:55:27 devstack cinder-volume[87726]: DEBUG cinder.volume.volume_utils [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Marking volume 95e9aa1b-e398-4617-a038-36e786610024 as bootable. {{(pid=87726) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 19:55:27 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Copying metadata from image 75754200-7cad-48b0-8f79-36bd3ba6f0db to 95e9aa1b-e398-4617-a038-36e786610024. {{(pid=87726) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 19:55:27 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Creating volume glance metadata for volume 95e9aa1b-e398-4617-a038-36e786610024 backed by image 75754200-7cad-48b0-8f79-36bd3ba6f0db with: {'image_id': '75754200-7cad-48b0-8f79-36bd3ba6f0db', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a739b829ef5c7c602ef182f06e37097b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87726) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 19:55:27 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a98181e-4a60-40c9-aa34-6951e6f2b103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95e9aa1b-e398-4617-a038-36e786610024', 'volume_size': 1, 'image_id': '75754200-7cad-48b0-8f79-36bd3ba6f0db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/75754200-7cad-48b0-8f79-36bd3ba6f0db', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a739b829ef5c7c602ef182f06e37097b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9a793bdff0bf473e9e911edb3a7ac3b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '77c0913433f0bc3d9d94b18418ccb971e49ca92d5fa6bae558806897fcf6fb7a74b64d7a6051874ef77c057f288560b73235d8f2c34dea9fb78c218276476c76', 'id': '75754200-7cad-48b0-8f79-36bd3ba6f0db', 'created_at': datetime.datetime(2026, 7, 17, 17, 55, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 17, 55, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/75754200-7cad-48b0-8f79-36bd3ba6f0db/file', 'properties': {}}, 'image_service': }' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:27 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7555c78b-a66e-480e-b617-62dfbf41e9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:27 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Volume volume-95e9aa1b-e398-4617-a038-36e786610024 (95e9aa1b-e398-4617-a038-36e786610024): created successfully Jul 17 19:55:27 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7555c78b-a66e-480e-b617-62dfbf41e9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:27 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Flow 'volume_create_manager' (0fc57ad3-e3a3-4e55-aaa2-e7c569e79fad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:27 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-6e46dbc2-ae02-4ae3-a0ff-3d619450029b tempest-VolumeImageDependencyTests-1314651589 None] Created volume successfully. Jul 17 19:55:27 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4d217e5a-9480-4daa-831a-a89037e6a239 tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c.152b5808-8ff0-4553-98df-81c2b026b667" returned: 0 in 0.549s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:27 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-4d217e5a-9480-4daa-831a-a89037e6a239 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56140e7c-7018-4b31-aadb-a2886a29553c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:55:27 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb727a34-c08a-4786-94d1-1cac933f3db5]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4d217e5a-9480-4daa-831a-a89037e6a239 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:27 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e4a24522-cd93-47e2-9751-c6523517776f tempest-CinderUnicodeTest-252967878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272.3f0068bb-ac11-4128-aee7-5f22b59b976d 1G" returned: 0 in 0.514s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e4a24522-cd93-47e2-9751-c6523517776f tempest-CinderUnicodeTest-252967878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-401060ac-f32b-4f23-9279-b23cf59f5272 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272.3f0068bb-ac11-4128-aee7-5f22b59b976d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:27 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-401060ac-f32b-4f23-9279-b23cf59f5272 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272.3f0068bb-ac11-4128-aee7-5f22b59b976d Jul 17 19:55:27 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:27 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c Jul 17 19:55:27 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:27 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e4a24522-cd93-47e2-9751-c6523517776f tempest-CinderUnicodeTest-252967878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-401060ac-f32b-4f23-9279-b23cf59f5272 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272.3f0068bb-ac11-4128-aee7-5f22b59b976d" returned: 0 in 0.328s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:27 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-e4a24522-cd93-47e2-9751-c6523517776f tempest-CinderUnicodeTest-252967878 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272.3f0068bb-ac11-4128-aee7-5f22b59b976d is being set with open permissions: ugo+rw Jul 17 19:55:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e4a24522-cd93-47e2-9751-c6523517776f tempest-CinderUnicodeTest-252967878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272.3f0068bb-ac11-4128-aee7-5f22b59b976d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:27 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272.3f0068bb-ac11-4128-aee7-5f22b59b976d Jul 17 19:55:27 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:27 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4d217e5a-9480-4daa-831a-a89037e6a239 tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c" returned: 0 in 0.455s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4d217e5a-9480-4daa-831a-a89037e6a239 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c.152b5808-8ff0-4553-98df-81c2b026b667 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:27 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c.152b5808-8ff0-4553-98df-81c2b026b667 Jul 17 19:55:27 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:28 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e4a24522-cd93-47e2-9751-c6523517776f tempest-CinderUnicodeTest-252967878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272.3f0068bb-ac11-4128-aee7-5f22b59b976d" returned: 0 in 0.275s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e4a24522-cd93-47e2-9751-c6523517776f tempest-CinderUnicodeTest-252967878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:28 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272.info Jul 17 19:55:28 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:28 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4d217e5a-9480-4daa-831a-a89037e6a239 tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c.152b5808-8ff0-4553-98df-81c2b026b667" returned: 0 in 0.397s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4d217e5a-9480-4daa-831a-a89037e6a239 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c.152b5808-8ff0-4553-98df-81c2b026b667 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:28 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c.152b5808-8ff0-4553-98df-81c2b026b667 Jul 17 19:55:28 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:28 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e4a24522-cd93-47e2-9751-c6523517776f tempest-CinderUnicodeTest-252967878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272.info" returned: 0 in 0.315s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:28 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-e4a24522-cd93-47e2-9751-c6523517776f tempest-CinderUnicodeTest-252967878 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272.info is being set with open permissions: ugo+rw Jul 17 19:55:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e4a24522-cd93-47e2-9751-c6523517776f tempest-CinderUnicodeTest-252967878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:28 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272.info Jul 17 19:55:28 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:28 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-41d5fbeb-e938-4ba7-b7d5-b681740ae326 tempest-VolumeImageDependencyTests-1314651589 None] Acquiring lock "cinder-95e9aa1b-e398-4617-a038-36e786610024-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4d217e5a-9480-4daa-831a-a89037e6a239 tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c.152b5808-8ff0-4553-98df-81c2b026b667" returned: 0 in 0.325s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-41d5fbeb-e938-4ba7-b7d5-b681740ae326 tempest-VolumeImageDependencyTests-1314651589 None] Lock "cinder-95e9aa1b-e398-4617-a038-36e786610024-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-4d217e5a-9480-4daa-831a-a89037e6a239 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "cinder-quobyte-152b5808-8ff0-4553-98df-81c2b026b667" released by "_delete_snapshot" :: held 1.899s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-4d217e5a-9480-4daa-831a-a89037e6a239 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "cinder-quobyte-56140e7c-7018-4b31-aadb-a2886a29553c" released by "delete_snapshot" :: held 1.939s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-41d5fbeb-e938-4ba7-b7d5-b681740ae326 tempest-VolumeImageDependencyTests-1314651589 None] Acquiring lock "cinder-quobyte-95e9aa1b-e398-4617-a038-36e786610024" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-41d5fbeb-e938-4ba7-b7d5-b681740ae326 tempest-VolumeImageDependencyTests-1314651589 None] Lock "cinder-quobyte-95e9aa1b-e398-4617-a038-36e786610024" acquired by "delete_volume" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:28 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[c152a19e-a2a6-44cb-b64e-f9084f0ad57f]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-41d5fbeb-e938-4ba7-b7d5-b681740ae326 tempest-VolumeImageDependencyTests-1314651589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-95e9aa1b-e398-4617-a038-36e786610024 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:28 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e4a24522-cd93-47e2-9751-c6523517776f tempest-CinderUnicodeTest-252967878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272.info" returned: 0 in 0.352s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e4a24522-cd93-47e2-9751-c6523517776f tempest-CinderUnicodeTest-252967878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.429s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:28 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-4d217e5a-9480-4daa-831a-a89037e6a239 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Created reservations ['d3577818-ac4a-44f6-9c71-3fdddd2b94b8', 'c6e3e9fd-f445-4baf-bf96-77bc7072e347', '479a8919-23ba-423c-833a-15324205fc26', '34e1a0ab-fd6f-4e47-a70b-33e81e6300b9'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:28 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e4a24522-cd93-47e2-9751-c6523517776f tempest-CinderUnicodeTest-252967878 None] Create snapshot completed successfully Jul 17 19:55:28 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-95e9aa1b-e398-4617-a038-36e786610024 Jul 17 19:55:28 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:28 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-4d217e5a-9480-4daa-831a-a89037e6a239 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Delete snapshot completed successfully. Jul 17 19:55:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-4d217e5a-9480-4daa-831a-a89037e6a239 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "cinder-152b5808-8ff0-4553-98df-81c2b026b667-delete_snapshot" released by "delete_snapshot" :: held 2.199s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:29 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-41d5fbeb-e938-4ba7-b7d5-b681740ae326 tempest-VolumeImageDependencyTests-1314651589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-95e9aa1b-e398-4617-a038-36e786610024" returned: 0 in 0.371s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-41d5fbeb-e938-4ba7-b7d5-b681740ae326 tempest-VolumeImageDependencyTests-1314651589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-95e9aa1b-e398-4617-a038-36e786610024 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:29 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-95e9aa1b-e398-4617-a038-36e786610024 Jul 17 19:55:29 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:29 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-41d5fbeb-e938-4ba7-b7d5-b681740ae326 tempest-VolumeImageDependencyTests-1314651589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-95e9aa1b-e398-4617-a038-36e786610024" returned: 0 in 0.249s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-41d5fbeb-e938-4ba7-b7d5-b681740ae326 tempest-VolumeImageDependencyTests-1314651589 None] Lock "cinder-quobyte-95e9aa1b-e398-4617-a038-36e786610024" released by "delete_volume" :: held 0.673s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:29 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-41d5fbeb-e938-4ba7-b7d5-b681740ae326 tempest-VolumeImageDependencyTests-1314651589 None] Created reservations ['caf17f2a-28ad-4385-907d-7d75d68539cb', 'c6323c5b-4d12-429e-acc1-a91ae9f87532', 'cdbd1d7d-a181-4c17-b04c-48e2b415c440', '88b3e7e7-5c37-4d04-b114-91f105ea9a03'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-41d5fbeb-e938-4ba7-b7d5-b681740ae326 tempest-VolumeImageDependencyTests-1314651589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-41d5fbeb-e938-4ba7-b7d5-b681740ae326 tempest-VolumeImageDependencyTests-1314651589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:29 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-41d5fbeb-e938-4ba7-b7d5-b681740ae326 tempest-VolumeImageDependencyTests-1314651589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:29 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-41d5fbeb-e938-4ba7-b7d5-b681740ae326 tempest-VolumeImageDependencyTests-1314651589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-41d5fbeb-e938-4ba7-b7d5-b681740ae326 tempest-VolumeImageDependencyTests-1314651589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-41d5fbeb-e938-4ba7-b7d5-b681740ae326 tempest-VolumeImageDependencyTests-1314651589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1089608a-7180-4a69-b492-eb038ee5a079 tempest-CinderUnicodeTest-252967878 None] Acquiring lock "cinder-3f0068bb-ac11-4128-aee7-5f22b59b976d-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:29 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:55:29 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1089608a-7180-4a69-b492-eb038ee5a079 tempest-CinderUnicodeTest-252967878 None] Lock "cinder-3f0068bb-ac11-4128-aee7-5f22b59b976d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1089608a-7180-4a69-b492-eb038ee5a079 tempest-CinderUnicodeTest-252967878 None] Acquiring lock "cinder-quobyte-401060ac-f32b-4f23-9279-b23cf59f5272" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1089608a-7180-4a69-b492-eb038ee5a079 tempest-CinderUnicodeTest-252967878 None] Lock "cinder-quobyte-401060ac-f32b-4f23-9279-b23cf59f5272" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1089608a-7180-4a69-b492-eb038ee5a079 tempest-CinderUnicodeTest-252967878 None] Acquiring lock "cinder-quobyte-3f0068bb-ac11-4128-aee7-5f22b59b976d" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1089608a-7180-4a69-b492-eb038ee5a079 tempest-CinderUnicodeTest-252967878 None] Lock "cinder-quobyte-3f0068bb-ac11-4128-aee7-5f22b59b976d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:29 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-1089608a-7180-4a69-b492-eb038ee5a079 tempest-CinderUnicodeTest-252967878 None] Deleting offline snapshot 3f0068bb-ac11-4128-aee7-5f22b59b976d of volume 401060ac-f32b-4f23-9279-b23cf59f5272 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:55:29 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-1089608a-7180-4a69-b492-eb038ee5a079 tempest-CinderUnicodeTest-252967878 None] snapshot_file for this snap is: volume-401060ac-f32b-4f23-9279-b23cf59f5272.3f0068bb-ac11-4128-aee7-5f22b59b976d {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:55:29 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9b0a55-c3e2-4aec-a4c8-c1db2f631713]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1089608a-7180-4a69-b492-eb038ee5a079 tempest-CinderUnicodeTest-252967878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272.3f0068bb-ac11-4128-aee7-5f22b59b976d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:29 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272.3f0068bb-ac11-4128-aee7-5f22b59b976d Jul 17 19:55:29 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:29 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-41d5fbeb-e938-4ba7-b7d5-b681740ae326 tempest-VolumeImageDependencyTests-1314651589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.343s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:29 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-41d5fbeb-e938-4ba7-b7d5-b681740ae326 tempest-VolumeImageDependencyTests-1314651589 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:55:29 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-41d5fbeb-e938-4ba7-b7d5-b681740ae326 tempest-VolumeImageDependencyTests-1314651589 None] Deleted volume successfully. Jul 17 19:55:30 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-41d5fbeb-e938-4ba7-b7d5-b681740ae326 tempest-VolumeImageDependencyTests-1314651589 None] Lock "cinder-95e9aa1b-e398-4617-a038-36e786610024-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:30 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ca692a05-21ce-43a0-a340-94bcc338cd09 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "cinder-56140e7c-7018-4b31-aadb-a2886a29553c-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:30 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ca692a05-21ce-43a0-a340-94bcc338cd09 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "cinder-56140e7c-7018-4b31-aadb-a2886a29553c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:30 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ca692a05-21ce-43a0-a340-94bcc338cd09 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "cinder-quobyte-56140e7c-7018-4b31-aadb-a2886a29553c" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:30 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ca692a05-21ce-43a0-a340-94bcc338cd09 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "cinder-quobyte-56140e7c-7018-4b31-aadb-a2886a29553c" acquired by "delete_volume" :: waited 0.017s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:30 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad23fd5-0eb9-4092-8e01-759fce9199ba]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ca692a05-21ce-43a0-a340-94bcc338cd09 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:30 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1089608a-7180-4a69-b492-eb038ee5a079 tempest-CinderUnicodeTest-252967878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272.3f0068bb-ac11-4128-aee7-5f22b59b976d" returned: 0 in 0.492s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:30 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-1089608a-7180-4a69-b492-eb038ee5a079 tempest-CinderUnicodeTest-252967878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-401060ac-f32b-4f23-9279-b23cf59f5272(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:55:30 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fa0175-16b9-43ef-a259-1e348302be55]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1089608a-7180-4a69-b492-eb038ee5a079 tempest-CinderUnicodeTest-252967878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:30 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c Jul 17 19:55:30 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:30 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272 Jul 17 19:55:30 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:30 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ca692a05-21ce-43a0-a340-94bcc338cd09 tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c" returned: 0 in 0.411s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ca692a05-21ce-43a0-a340-94bcc338cd09 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:30 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c Jul 17 19:55:30 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:30 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1089608a-7180-4a69-b492-eb038ee5a079 tempest-CinderUnicodeTest-252967878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272" returned: 0 in 0.444s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1089608a-7180-4a69-b492-eb038ee5a079 tempest-CinderUnicodeTest-252967878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272.3f0068bb-ac11-4128-aee7-5f22b59b976d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:30 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272.3f0068bb-ac11-4128-aee7-5f22b59b976d Jul 17 19:55:30 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:30 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ca692a05-21ce-43a0-a340-94bcc338cd09 tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-56140e7c-7018-4b31-aadb-a2886a29553c" returned: 0 in 0.351s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ca692a05-21ce-43a0-a340-94bcc338cd09 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "cinder-quobyte-56140e7c-7018-4b31-aadb-a2886a29553c" released by "delete_volume" :: held 0.851s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-ca692a05-21ce-43a0-a340-94bcc338cd09 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Created reservations ['1e78d9c1-a3d0-4b2a-8f49-a47c1aad74ec', '954ad948-bb61-49c9-9193-d64a028fde1d', '30bf3469-0981-4d07-a108-78c09bd1edc5', 'e01dbb4c-8b9e-4f3d-844d-2310c8a0d56c'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ca692a05-21ce-43a0-a340-94bcc338cd09 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ca692a05-21ce-43a0-a340-94bcc338cd09 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ca692a05-21ce-43a0-a340-94bcc338cd09 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ca692a05-21ce-43a0-a340-94bcc338cd09 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ca692a05-21ce-43a0-a340-94bcc338cd09 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ca692a05-21ce-43a0-a340-94bcc338cd09 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:31 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:55:31 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:31 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1089608a-7180-4a69-b492-eb038ee5a079 tempest-CinderUnicodeTest-252967878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272.3f0068bb-ac11-4128-aee7-5f22b59b976d" returned: 0 in 0.574s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1089608a-7180-4a69-b492-eb038ee5a079 tempest-CinderUnicodeTest-252967878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272.3f0068bb-ac11-4128-aee7-5f22b59b976d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:31 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272.3f0068bb-ac11-4128-aee7-5f22b59b976d Jul 17 19:55:31 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] Flow 'volume_create_manager' (0f3c094c-5a9d-4165-b579-e74112cab072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94293107-a329-47a3-8570-986ee342f54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94293107-a329-47a3-8570-986ee342f54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-695051433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab32038b-af54-4bdf-97f9-ba0790ff8db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a961f6d6198c4d7b965c7b648e811847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:31Z,use_quota=True,user_id='1bbf0336f6864f9095c7c9500272fb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe5aa5e0-b3cf-4134-8690-d0ad2057c25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe5aa5e0-b3cf-4134-8690-d0ad2057c25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f6160d9-8898-4c5f-97eb-100f707baedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f6160d9-8898-4c5f-97eb-100f707baedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab32038b-af54-4bdf-97f9-ba0790ff8db9', 'volume_name': 'volume-ab32038b-af54-4bdf-97f9-ba0790ff8db9', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7efc1e90-6537-47b5-9edd-c3a1845a8d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7efc1e90-6537-47b5-9edd-c3a1845a8d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cae83fc-df79-43af-b4e8-449d95bee139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:31 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] Volume ab32038b-af54-4bdf-97f9-ba0790ff8db9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab32038b-af54-4bdf-97f9-ba0790ff8db9', 'volume_size': 1} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-695051433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab32038b-af54-4bdf-97f9-ba0790ff8db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a961f6d6198c4d7b965c7b648e811847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:31Z,use_quota=True,user_id='1bbf0336f6864f9095c7c9500272fb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] Creating volume ab32038b-af54-4bdf-97f9-ba0790ff8db9 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:55:31 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ab32038b-af54-4bdf-97f9-ba0790ff8db9 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:31 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ab32038b-af54-4bdf-97f9-ba0790ff8db9 1073741824 Jul 17 19:55:31 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:31 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-1089608a-7180-4a69-b492-eb038ee5a079 tempest-CinderUnicodeTest-252967878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272.3f0068bb-ac11-4128-aee7-5f22b59b976d" returned: 0 in 0.340s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1089608a-7180-4a69-b492-eb038ee5a079 tempest-CinderUnicodeTest-252967878 None] Lock "cinder-quobyte-3f0068bb-ac11-4128-aee7-5f22b59b976d" released by "_delete_snapshot" :: held 2.013s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:31 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1089608a-7180-4a69-b492-eb038ee5a079 tempest-CinderUnicodeTest-252967878 None] Lock "cinder-quobyte-401060ac-f32b-4f23-9279-b23cf59f5272" released by "delete_snapshot" :: held 2.038s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ca692a05-21ce-43a0-a340-94bcc338cd09 tempest-CreateVolumesFromSnapshotTest-1952803094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.489s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-ca692a05-21ce-43a0-a340-94bcc338cd09 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:55:31 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-ca692a05-21ce-43a0-a340-94bcc338cd09 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Deleted volume successfully. Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ca692a05-21ce-43a0-a340-94bcc338cd09 tempest-CreateVolumesFromSnapshotTest-1952803094 None] Lock "cinder-56140e7c-7018-4b31-aadb-a2886a29553c-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-1089608a-7180-4a69-b492-eb038ee5a079 tempest-CinderUnicodeTest-252967878 None] Created reservations ['b0bdb55a-4f8c-4b09-b574-0dc975674837', 'c4ff6f50-743c-4d68-bc9a-5b1467d13d0e', 'd21a1b8a-a641-4923-8435-48b5c76d9cd8', '3077aa78-746b-481d-a833-7712555ba930'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:31 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-1089608a-7180-4a69-b492-eb038ee5a079 tempest-CinderUnicodeTest-252967878 None] Delete snapshot completed successfully. Jul 17 19:55:31 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-1089608a-7180-4a69-b492-eb038ee5a079 tempest-CinderUnicodeTest-252967878 None] Lock "cinder-3f0068bb-ac11-4128-aee7-5f22b59b976d-delete_snapshot" released by "delete_snapshot" :: held 2.234s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:32 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ab32038b-af54-4bdf-97f9-ba0790ff8db9 1073741824" returned: 0 in 0.608s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ab32038b-af54-4bdf-97f9-ba0790ff8db9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:32 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ab32038b-af54-4bdf-97f9-ba0790ff8db9 Jul 17 19:55:32 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:32 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ab32038b-af54-4bdf-97f9-ba0790ff8db9" returned: 0 in 0.306s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:32 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:55:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cae83fc-df79-43af-b4e8-449d95bee139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab32038b-af54-4bdf-97f9-ba0790ff8db9', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c92f12-b153-4836-81c8-36c6121301a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:32 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] Volume volume-ab32038b-af54-4bdf-97f9-ba0790ff8db9 (ab32038b-af54-4bdf-97f9-ba0790ff8db9): created successfully Jul 17 19:55:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c92f12-b153-4836-81c8-36c6121301a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] Flow 'volume_create_manager' (0f3c094c-5a9d-4165-b579-e74112cab072) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:32 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-a8030160-65a5-4caa-baf0-e0df7819adcb tempest-ProjectReaderTests-1558016302 None] Created volume successfully. Jul 17 19:55:32 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-92d84fd1-11cd-4937-b9e1-8b00f8673983 tempest-CinderUnicodeTest-252967878 None] Acquiring lock "cinder-401060ac-f32b-4f23-9279-b23cf59f5272-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:32 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-92d84fd1-11cd-4937-b9e1-8b00f8673983 tempest-CinderUnicodeTest-252967878 None] Lock "cinder-401060ac-f32b-4f23-9279-b23cf59f5272-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:32 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-92d84fd1-11cd-4937-b9e1-8b00f8673983 tempest-CinderUnicodeTest-252967878 None] Acquiring lock "cinder-quobyte-401060ac-f32b-4f23-9279-b23cf59f5272" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:32 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-92d84fd1-11cd-4937-b9e1-8b00f8673983 tempest-CinderUnicodeTest-252967878 None] Lock "cinder-quobyte-401060ac-f32b-4f23-9279-b23cf59f5272" acquired by "delete_volume" :: waited 0.019s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:32 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0d6d78-0cfb-4bd5-a049-0dbb00a43ab9]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-92d84fd1-11cd-4937-b9e1-8b00f8673983 tempest-CinderUnicodeTest-252967878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:33 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272 Jul 17 19:55:33 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:33 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-92d84fd1-11cd-4937-b9e1-8b00f8673983 tempest-CinderUnicodeTest-252967878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272" returned: 0 in 0.408s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-92d84fd1-11cd-4937-b9e1-8b00f8673983 tempest-CinderUnicodeTest-252967878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:33 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272 Jul 17 19:55:33 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:33 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-92d84fd1-11cd-4937-b9e1-8b00f8673983 tempest-CinderUnicodeTest-252967878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-401060ac-f32b-4f23-9279-b23cf59f5272" returned: 0 in 0.296s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:33 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-92d84fd1-11cd-4937-b9e1-8b00f8673983 tempest-CinderUnicodeTest-252967878 None] Lock "cinder-quobyte-401060ac-f32b-4f23-9279-b23cf59f5272" released by "delete_volume" :: held 0.783s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:33 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-92d84fd1-11cd-4937-b9e1-8b00f8673983 tempest-CinderUnicodeTest-252967878 None] Created reservations ['7aa56f4f-5e2c-483a-86d2-f8788a58b434', '4fbd85fd-de5d-4c33-a434-f38fc10da93d', 'a879cce8-a7f5-49ca-8bc4-c3c32d575c77', 'ffa547fe-7d3e-4585-82b5-a66514ea4fcc'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:33 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d9fb3d5d-3213-495e-a37f-cc5b17f173fe tempest-ProjectReaderTests-1558016302 None] Acquiring lock "cinder-ab32038b-af54-4bdf-97f9-ba0790ff8db9-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-92d84fd1-11cd-4937-b9e1-8b00f8673983 tempest-CinderUnicodeTest-252967878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-92d84fd1-11cd-4937-b9e1-8b00f8673983 tempest-CinderUnicodeTest-252967878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-92d84fd1-11cd-4937-b9e1-8b00f8673983 tempest-CinderUnicodeTest-252967878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-92d84fd1-11cd-4937-b9e1-8b00f8673983 tempest-CinderUnicodeTest-252967878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-92d84fd1-11cd-4937-b9e1-8b00f8673983 tempest-CinderUnicodeTest-252967878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-92d84fd1-11cd-4937-b9e1-8b00f8673983 tempest-CinderUnicodeTest-252967878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:33 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d9fb3d5d-3213-495e-a37f-cc5b17f173fe tempest-ProjectReaderTests-1558016302 None] Lock "cinder-ab32038b-af54-4bdf-97f9-ba0790ff8db9-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:33 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:55:33 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:33 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d9fb3d5d-3213-495e-a37f-cc5b17f173fe tempest-ProjectReaderTests-1558016302 None] Acquiring lock "cinder-quobyte-ab32038b-af54-4bdf-97f9-ba0790ff8db9" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:34 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d9fb3d5d-3213-495e-a37f-cc5b17f173fe tempest-ProjectReaderTests-1558016302 None] Lock "cinder-quobyte-ab32038b-af54-4bdf-97f9-ba0790ff8db9" acquired by "delete_volume" :: waited 0.024s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:34 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8c2c86-1036-453f-b65c-7475a0a7dc6d]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d9fb3d5d-3213-495e-a37f-cc5b17f173fe tempest-ProjectReaderTests-1558016302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ab32038b-af54-4bdf-97f9-ba0790ff8db9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:34 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a13cb3a2-f13d-42ec-b4a4-fb236d4327ac tempest-CinderUnicodeTest-252967878 None] Acquiring lock "cinder-7c18382d-138f-41da-ac73-4bd560588c02-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:34 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a13cb3a2-f13d-42ec-b4a4-fb236d4327ac tempest-CinderUnicodeTest-252967878 None] Lock "cinder-7c18382d-138f-41da-ac73-4bd560588c02-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:34 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a13cb3a2-f13d-42ec-b4a4-fb236d4327ac tempest-CinderUnicodeTest-252967878 None] Acquiring lock "cinder-quobyte-7c18382d-138f-41da-ac73-4bd560588c02" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:34 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a13cb3a2-f13d-42ec-b4a4-fb236d4327ac tempest-CinderUnicodeTest-252967878 None] Lock "cinder-quobyte-7c18382d-138f-41da-ac73-4bd560588c02" acquired by "delete_volume" :: waited 0.039s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:34 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ab32038b-af54-4bdf-97f9-ba0790ff8db9 Jul 17 19:55:34 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:34 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcc0b02-18c4-4b18-aee2-c7a65ce0cfb9]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a13cb3a2-f13d-42ec-b4a4-fb236d4327ac tempest-CinderUnicodeTest-252967878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7c18382d-138f-41da-ac73-4bd560588c02 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:34 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-92d84fd1-11cd-4937-b9e1-8b00f8673983 tempest-CinderUnicodeTest-252967878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.407s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:34 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-92d84fd1-11cd-4937-b9e1-8b00f8673983 tempest-CinderUnicodeTest-252967878 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:55:34 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-92d84fd1-11cd-4937-b9e1-8b00f8673983 tempest-CinderUnicodeTest-252967878 None] Deleted volume successfully. Jul 17 19:55:34 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-92d84fd1-11cd-4937-b9e1-8b00f8673983 tempest-CinderUnicodeTest-252967878 None] Lock "cinder-401060ac-f32b-4f23-9279-b23cf59f5272-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:34 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7c18382d-138f-41da-ac73-4bd560588c02 Jul 17 19:55:34 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:34 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d9fb3d5d-3213-495e-a37f-cc5b17f173fe tempest-ProjectReaderTests-1558016302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ab32038b-af54-4bdf-97f9-ba0790ff8db9" returned: 0 in 0.520s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d9fb3d5d-3213-495e-a37f-cc5b17f173fe tempest-ProjectReaderTests-1558016302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ab32038b-af54-4bdf-97f9-ba0790ff8db9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:34 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ab32038b-af54-4bdf-97f9-ba0790ff8db9 Jul 17 19:55:34 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:34 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a13cb3a2-f13d-42ec-b4a4-fb236d4327ac tempest-CinderUnicodeTest-252967878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7c18382d-138f-41da-ac73-4bd560588c02" returned: 0 in 0.512s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a13cb3a2-f13d-42ec-b4a4-fb236d4327ac tempest-CinderUnicodeTest-252967878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7c18382d-138f-41da-ac73-4bd560588c02 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:34 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7c18382d-138f-41da-ac73-4bd560588c02 Jul 17 19:55:34 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:34 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d9fb3d5d-3213-495e-a37f-cc5b17f173fe tempest-ProjectReaderTests-1558016302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-ab32038b-af54-4bdf-97f9-ba0790ff8db9" returned: 0 in 0.322s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:34 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d9fb3d5d-3213-495e-a37f-cc5b17f173fe tempest-ProjectReaderTests-1558016302 None] Lock "cinder-quobyte-ab32038b-af54-4bdf-97f9-ba0790ff8db9" released by "delete_volume" :: held 0.913s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:34 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:55:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] Flow 'volume_create_manager' (061ece93-fff3-419d-845f-6d3c9cecdf8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca361dc7-90dd-4acd-8fbe-99c0d3e8dfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca361dc7-90dd-4acd-8fbe-99c0d3e8dfea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1292375797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bb80a8f-5284-4bf0-9216-0108bf26d6d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='774eb866e4b54402a3074ae91f7d9529',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:35Z,use_quota=True,user_id='fb9e0bd91c174b75a8832d118ad9ce51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c75cdb95-d9e2-429b-8a10-6903ce97fa68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c75cdb95-d9e2-429b-8a10-6903ce97fa68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a6632d7-8f27-4a1c-86ea-f98f993a9a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a6632d7-8f27-4a1c-86ea-f98f993a9a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bb80a8f-5284-4bf0-9216-0108bf26d6d4', 'volume_name': 'volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614d2292-145b-428a-95d5-3faed35bfd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614d2292-145b-428a-95d5-3faed35bfd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a5dc063-e5a1-41f1-84d0-cc83436324fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:35 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] Volume 6bb80a8f-5284-4bf0-9216-0108bf26d6d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4', 'volume_size': 1} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1292375797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bb80a8f-5284-4bf0-9216-0108bf26d6d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='774eb866e4b54402a3074ae91f7d9529',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:35Z,use_quota=True,user_id='fb9e0bd91c174b75a8832d118ad9ce51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] Creating volume 6bb80a8f-5284-4bf0-9216-0108bf26d6d4 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:55:35 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:35 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4 1073741824 Jul 17 19:55:35 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:35 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-d9fb3d5d-3213-495e-a37f-cc5b17f173fe tempest-ProjectReaderTests-1558016302 None] Created reservations ['d9f90cf2-d46f-48d7-8e6d-fe5336931cb9', '737971c7-c632-4a29-817b-871a65796a08', 'bb414b7e-b663-4e7a-ba5a-e9ecd86a24ba', 'a4e34402-65b3-4cf7-972e-b34e8c2f7153'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a13cb3a2-f13d-42ec-b4a4-fb236d4327ac tempest-CinderUnicodeTest-252967878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-7c18382d-138f-41da-ac73-4bd560588c02" returned: 0 in 0.341s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a13cb3a2-f13d-42ec-b4a4-fb236d4327ac tempest-CinderUnicodeTest-252967878 None] Lock "cinder-quobyte-7c18382d-138f-41da-ac73-4bd560588c02" released by "delete_volume" :: held 0.909s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-a13cb3a2-f13d-42ec-b4a4-fb236d4327ac tempest-CinderUnicodeTest-252967878 None] Created reservations ['1145ac56-ab48-45eb-9a69-4cd54e041595', '44e4214e-5465-4c9b-a319-e24c885e9636', 'd01d5868-c088-4c19-b290-ec8ec2badf4c', '5b57b36d-7309-41d9-a5ac-72abf7171a8c'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d9fb3d5d-3213-495e-a37f-cc5b17f173fe tempest-ProjectReaderTests-1558016302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d9fb3d5d-3213-495e-a37f-cc5b17f173fe tempest-ProjectReaderTests-1558016302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d9fb3d5d-3213-495e-a37f-cc5b17f173fe tempest-ProjectReaderTests-1558016302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d9fb3d5d-3213-495e-a37f-cc5b17f173fe tempest-ProjectReaderTests-1558016302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d9fb3d5d-3213-495e-a37f-cc5b17f173fe tempest-ProjectReaderTests-1558016302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d9fb3d5d-3213-495e-a37f-cc5b17f173fe tempest-ProjectReaderTests-1558016302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:35 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:55:35 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a13cb3a2-f13d-42ec-b4a4-fb236d4327ac tempest-CinderUnicodeTest-252967878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a13cb3a2-f13d-42ec-b4a4-fb236d4327ac tempest-CinderUnicodeTest-252967878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a13cb3a2-f13d-42ec-b4a4-fb236d4327ac tempest-CinderUnicodeTest-252967878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-a13cb3a2-f13d-42ec-b4a4-fb236d4327ac tempest-CinderUnicodeTest-252967878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a13cb3a2-f13d-42ec-b4a4-fb236d4327ac tempest-CinderUnicodeTest-252967878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a13cb3a2-f13d-42ec-b4a4-fb236d4327ac tempest-CinderUnicodeTest-252967878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:35 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:55:35 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:35 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d9fb3d5d-3213-495e-a37f-cc5b17f173fe tempest-ProjectReaderTests-1558016302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.272s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-d9fb3d5d-3213-495e-a37f-cc5b17f173fe tempest-ProjectReaderTests-1558016302 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:55:35 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-d9fb3d5d-3213-495e-a37f-cc5b17f173fe tempest-ProjectReaderTests-1558016302 None] Deleted volume successfully. Jul 17 19:55:35 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-d9fb3d5d-3213-495e-a37f-cc5b17f173fe tempest-ProjectReaderTests-1558016302 None] Lock "cinder-ab32038b-af54-4bdf-97f9-ba0790ff8db9-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4 1073741824" returned: 0 in 0.491s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:35 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a13cb3a2-f13d-42ec-b4a4-fb236d4327ac tempest-CinderUnicodeTest-252967878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.292s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-a13cb3a2-f13d-42ec-b4a4-fb236d4327ac tempest-CinderUnicodeTest-252967878 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:55:35 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-a13cb3a2-f13d-42ec-b4a4-fb236d4327ac tempest-CinderUnicodeTest-252967878 None] Deleted volume successfully. Jul 17 19:55:35 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4 Jul 17 19:55:35 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-a13cb3a2-f13d-42ec-b4a4-fb236d4327ac tempest-CinderUnicodeTest-252967878 None] Lock "cinder-7c18382d-138f-41da-ac73-4bd560588c02-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:35 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4" returned: 0 in 0.296s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a5dc063-e5a1-41f1-84d0-cc83436324fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24423a0f-24cd-412b-b9b1-4fd46a54fa96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:35 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] Volume volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4 (6bb80a8f-5284-4bf0-9216-0108bf26d6d4): created successfully Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24423a0f-24cd-412b-b9b1-4fd46a54fa96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:35 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] Flow 'volume_create_manager' (061ece93-fff3-419d-845f-6d3c9cecdf8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:35 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e2dd92e8-3292-4a8a-8577-de408c00dd94 tempest-VolumeDependencyTests-144218068 None] Created volume successfully. Jul 17 19:55:36 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:55:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] Flow 'volume_create_manager' (391b8ff3-c807-47ec-b83e-cc87c7ed9acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44215f8f-20fd-457f-b5f5-f5943d56e696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44215f8f-20fd-457f-b5f5-f5943d56e696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-721920206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e69f62-fb05-418a-ba9f-1d23ac144c62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a961f6d6198c4d7b965c7b648e811847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:37Z,use_quota=True,user_id='1bbf0336f6864f9095c7c9500272fb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c1cca9-8f17-405f-87db-c81f749dc313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c1cca9-8f17-405f-87db-c81f749dc313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a110930-40d6-44a9-a262-851a9750f518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a110930-40d6-44a9-a262-851a9750f518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41e69f62-fb05-418a-ba9f-1d23ac144c62', 'volume_name': 'volume-41e69f62-fb05-418a-ba9f-1d23ac144c62', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0595a65-f675-4fa6-9d2a-4b4a11ed1873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0595a65-f675-4fa6-9d2a-4b4a11ed1873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f064e161-c073-4a9a-b8ab-87afbe046737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:36 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] Volume 41e69f62-fb05-418a-ba9f-1d23ac144c62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41e69f62-fb05-418a-ba9f-1d23ac144c62', 'volume_size': 1} Jul 17 19:55:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-721920206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e69f62-fb05-418a-ba9f-1d23ac144c62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a961f6d6198c4d7b965c7b648e811847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:37Z,use_quota=True,user_id='1bbf0336f6864f9095c7c9500272fb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:55:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] Creating volume 41e69f62-fb05-418a-ba9f-1d23ac144c62 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:55:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:55:36 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:55:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-41e69f62-fb05-418a-ba9f-1d23ac144c62 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:36 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-41e69f62-fb05-418a-ba9f-1d23ac144c62 1073741824 Jul 17 19:55:36 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b057d41a-1406-405e-8427-da491997629f tempest-VolumeDependencyTests-144218068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:37 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-41e69f62-fb05-418a-ba9f-1d23ac144c62 1073741824" returned: 0 in 0.585s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-41e69f62-fb05-418a-ba9f-1d23ac144c62 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:37 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-41e69f62-fb05-418a-ba9f-1d23ac144c62 Jul 17 19:55:37 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:37 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-41e69f62-fb05-418a-ba9f-1d23ac144c62" returned: 0 in 0.300s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:55:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b057d41a-1406-405e-8427-da491997629f tempest-VolumeDependencyTests-144218068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.472s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f064e161-c073-4a9a-b8ab-87afbe046737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41e69f62-fb05-418a-ba9f-1d23ac144c62', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1566a196-8351-4e38-9d01-123ba8601cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-b057d41a-1406-405e-8427-da491997629f tempest-VolumeDependencyTests-144218068 None] Creating offline snapshot 25d01e28-a205-4500-85a0-d1d4f603bef4 of volume 6bb80a8f-5284-4bf0-9216-0108bf26d6d4 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:55:37 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] Volume volume-41e69f62-fb05-418a-ba9f-1d23ac144c62 (41e69f62-fb05-418a-ba9f-1d23ac144c62): created successfully Jul 17 19:55:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1566a196-8351-4e38-9d01-123ba8601cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] Flow 'volume_create_manager' (391b8ff3-c807-47ec-b83e-cc87c7ed9acf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:37 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa11cd92-502a-4d75-990b-1d7613b887cb]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b057d41a-1406-405e-8427-da491997629f tempest-VolumeDependencyTests-144218068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:37 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-cacfe9b1-2adc-4973-a17f-47e251705134 tempest-ProjectReaderTests-1558016302 None] Created volume successfully. Jul 17 19:55:37 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4 Jul 17 19:55:37 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:38 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b057d41a-1406-405e-8427-da491997629f tempest-VolumeDependencyTests-144218068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4" returned: 0 in 0.379s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b057d41a-1406-405e-8427-da491997629f tempest-VolumeDependencyTests-144218068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4.25d01e28-a205-4500-85a0-d1d4f603bef4 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:38 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4.25d01e28-a205-4500-85a0-d1d4f603bef4 1G Jul 17 19:55:38 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:38 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b057d41a-1406-405e-8427-da491997629f tempest-VolumeDependencyTests-144218068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4.25d01e28-a205-4500-85a0-d1d4f603bef4 1G" returned: 0 in 0.534s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b057d41a-1406-405e-8427-da491997629f tempest-VolumeDependencyTests-144218068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4.25d01e28-a205-4500-85a0-d1d4f603bef4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:38 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4.25d01e28-a205-4500-85a0-d1d4f603bef4 Jul 17 19:55:38 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:38 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9eb1f979-3e7a-496e-86c1-f1ce70e66d3b tempest-ProjectReaderTests-1558016302 None] Acquiring lock "cinder-41e69f62-fb05-418a-ba9f-1d23ac144c62-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:38 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9eb1f979-3e7a-496e-86c1-f1ce70e66d3b tempest-ProjectReaderTests-1558016302 None] Lock "cinder-41e69f62-fb05-418a-ba9f-1d23ac144c62-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:38 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9eb1f979-3e7a-496e-86c1-f1ce70e66d3b tempest-ProjectReaderTests-1558016302 None] Acquiring lock "cinder-quobyte-41e69f62-fb05-418a-ba9f-1d23ac144c62" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:38 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9eb1f979-3e7a-496e-86c1-f1ce70e66d3b tempest-ProjectReaderTests-1558016302 None] Lock "cinder-quobyte-41e69f62-fb05-418a-ba9f-1d23ac144c62" acquired by "delete_volume" :: waited 0.021s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:38 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[15929129-1f78-4794-be8a-5afffbb062ae]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9eb1f979-3e7a-496e-86c1-f1ce70e66d3b tempest-ProjectReaderTests-1558016302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-41e69f62-fb05-418a-ba9f-1d23ac144c62 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:39 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-41e69f62-fb05-418a-ba9f-1d23ac144c62 Jul 17 19:55:39 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:39 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b057d41a-1406-405e-8427-da491997629f tempest-VolumeDependencyTests-144218068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4.25d01e28-a205-4500-85a0-d1d4f603bef4" returned: 0 in 0.421s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:39 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-b057d41a-1406-405e-8427-da491997629f tempest-VolumeDependencyTests-144218068 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4.25d01e28-a205-4500-85a0-d1d4f603bef4 is being set with open permissions: ugo+rw Jul 17 19:55:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b057d41a-1406-405e-8427-da491997629f tempest-VolumeDependencyTests-144218068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4.25d01e28-a205-4500-85a0-d1d4f603bef4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:39 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4.25d01e28-a205-4500-85a0-d1d4f603bef4 Jul 17 19:55:39 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:39 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-1fca2fcb-5d98-4797-a61b-3b1e284bcf9f tempest-ProjectAdminTests-880594417 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7513999938965, 'free_capacity_gb': 1775.7513999938965, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87726) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 17 19:55:39 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9eb1f979-3e7a-496e-86c1-f1ce70e66d3b tempest-ProjectReaderTests-1558016302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-41e69f62-fb05-418a-ba9f-1d23ac144c62" returned: 0 in 0.446s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9eb1f979-3e7a-496e-86c1-f1ce70e66d3b tempest-ProjectReaderTests-1558016302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-41e69f62-fb05-418a-ba9f-1d23ac144c62 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:39 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-41e69f62-fb05-418a-ba9f-1d23ac144c62 Jul 17 19:55:39 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:39 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b057d41a-1406-405e-8427-da491997629f tempest-VolumeDependencyTests-144218068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4.25d01e28-a205-4500-85a0-d1d4f603bef4" returned: 0 in 0.352s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b057d41a-1406-405e-8427-da491997629f tempest-VolumeDependencyTests-144218068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:39 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4.info Jul 17 19:55:39 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:39 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9eb1f979-3e7a-496e-86c1-f1ce70e66d3b tempest-ProjectReaderTests-1558016302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-41e69f62-fb05-418a-ba9f-1d23ac144c62" returned: 0 in 0.310s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:39 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9eb1f979-3e7a-496e-86c1-f1ce70e66d3b tempest-ProjectReaderTests-1558016302 None] Lock "cinder-quobyte-41e69f62-fb05-418a-ba9f-1d23ac144c62" released by "delete_volume" :: held 0.808s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:39 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-9eb1f979-3e7a-496e-86c1-f1ce70e66d3b tempest-ProjectReaderTests-1558016302 None] Created reservations ['9bee7820-ae5d-4caa-a7b9-c56c91f75dea', '2ba34b6c-53ba-4667-bdb7-c8fdfd680bd8', 'be9b196f-04a6-4275-83a5-27accd6d211a', 'e69c64e2-01cc-4d2e-a166-3ced294f42ab'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:39 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b057d41a-1406-405e-8427-da491997629f tempest-VolumeDependencyTests-144218068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4.info" returned: 0 in 0.301s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:39 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-b057d41a-1406-405e-8427-da491997629f tempest-VolumeDependencyTests-144218068 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4.info is being set with open permissions: ugo+rw Jul 17 19:55:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b057d41a-1406-405e-8427-da491997629f tempest-VolumeDependencyTests-144218068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:39 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4.info Jul 17 19:55:39 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9eb1f979-3e7a-496e-86c1-f1ce70e66d3b tempest-ProjectReaderTests-1558016302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9eb1f979-3e7a-496e-86c1-f1ce70e66d3b tempest-ProjectReaderTests-1558016302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:39 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9eb1f979-3e7a-496e-86c1-f1ce70e66d3b tempest-ProjectReaderTests-1558016302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:39 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9eb1f979-3e7a-496e-86c1-f1ce70e66d3b tempest-ProjectReaderTests-1558016302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9eb1f979-3e7a-496e-86c1-f1ce70e66d3b tempest-ProjectReaderTests-1558016302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9eb1f979-3e7a-496e-86c1-f1ce70e66d3b tempest-ProjectReaderTests-1558016302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:39 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:55:39 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:40 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b057d41a-1406-405e-8427-da491997629f tempest-VolumeDependencyTests-144218068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4.info" returned: 0 in 0.317s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b057d41a-1406-405e-8427-da491997629f tempest-VolumeDependencyTests-144218068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.432s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:40 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9eb1f979-3e7a-496e-86c1-f1ce70e66d3b tempest-ProjectReaderTests-1558016302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.317s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:40 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-b057d41a-1406-405e-8427-da491997629f tempest-VolumeDependencyTests-144218068 None] Create snapshot completed successfully Jul 17 19:55:40 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-9eb1f979-3e7a-496e-86c1-f1ce70e66d3b tempest-ProjectReaderTests-1558016302 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:55:40 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-9eb1f979-3e7a-496e-86c1-f1ce70e66d3b tempest-ProjectReaderTests-1558016302 None] Deleted volume successfully. Jul 17 19:55:40 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9eb1f979-3e7a-496e-86c1-f1ce70e66d3b tempest-ProjectReaderTests-1558016302 None] Lock "cinder-41e69f62-fb05-418a-ba9f-1d23ac144c62-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:40 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:55:40 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] Flow 'volume_create_manager' (846dbeda-1ea5-46f0-b955-6099e348647f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:40 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b289af7f-9606-4938-8f63-6238dee482d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:40 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b289af7f-9606-4938-8f63-6238dee482d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1109030956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69e08aa-ba53-4928-8fe1-63df4f6bdd2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a961f6d6198c4d7b965c7b648e811847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:41Z,use_quota=True,user_id='1bbf0336f6864f9095c7c9500272fb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:40 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0d8df1-c94a-499b-b78b-ce2f8a1b0bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:40 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0d8df1-c94a-499b-b78b-ce2f8a1b0bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:40 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62483478-cbb0-4893-926a-685fa7b5baf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:40 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62483478-cbb0-4893-926a-685fa7b5baf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b69e08aa-ba53-4928-8fe1-63df4f6bdd2e', 'volume_name': 'volume-b69e08aa-ba53-4928-8fe1-63df4f6bdd2e', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:40 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774b1a73-7eb5-4ea9-b43d-957f53b99b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:40 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774b1a73-7eb5-4ea9-b43d-957f53b99b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:40 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f65937-8805-4b72-b6af-3661729d5615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:40 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] Volume b69e08aa-ba53-4928-8fe1-63df4f6bdd2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b69e08aa-ba53-4928-8fe1-63df4f6bdd2e', 'volume_size': 1} Jul 17 19:55:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:40 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1109030956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69e08aa-ba53-4928-8fe1-63df4f6bdd2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a961f6d6198c4d7b965c7b648e811847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:41Z,use_quota=True,user_id='1bbf0336f6864f9095c7c9500272fb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:55:40 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] Creating volume b69e08aa-ba53-4928-8fe1-63df4f6bdd2e {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:55:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:40 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:40 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:40 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:55:40 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:55:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b69e08aa-ba53-4928-8fe1-63df4f6bdd2e 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:40 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b69e08aa-ba53-4928-8fe1-63df4f6bdd2e 1073741824 Jul 17 19:55:40 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Flow 'volume_create_manager' (b96ae2b7-faf8-4791-96d9-7051e4ef7e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9905acf-1dc0-4701-8bdc-317d8292534f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9905acf-1dc0-4701-8bdc-317d8292534f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1662041276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86ecca8c-18ec-46bc-a181-07d48eac6a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='774eb866e4b54402a3074ae91f7d9529',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=25d01e28-a205-4500-85a0-d1d4f603bef4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:41Z,use_quota=True,user_id='fb9e0bd91c174b75a8832d118ad9ce51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca7b0aa-5b75-497c-bfca-2c9419b94066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca7b0aa-5b75-497c-bfca-2c9419b94066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e8004cf-e6a9-4289-a6d0-3efb0ffbd5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e8004cf-e6a9-4289-a6d0-3efb0ffbd5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '86ecca8c-18ec-46bc-a181-07d48eac6a98', 'volume_name': 'volume-86ecca8c-18ec-46bc-a181-07d48eac6a98', 'volume_size': 1, 'snapshot_id': '25d01e28-a205-4500-85a0-d1d4f603bef4'}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d132fa1-79b0-414e-8f93-371baf07e5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d132fa1-79b0-414e-8f93-371baf07e5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (551da8b2-ffda-4443-9ff1-54b781b8a2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:41 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Volume 86ecca8c-18ec-46bc-a181-07d48eac6a98: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-86ecca8c-18ec-46bc-a181-07d48eac6a98', 'volume_size': 1, 'snapshot_id': '25d01e28-a205-4500-85a0-d1d4f603bef4'} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:41 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b69e08aa-ba53-4928-8fe1-63df4f6bdd2e 1073741824" returned: 0 in 0.663s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b69e08aa-ba53-4928-8fe1-63df4f6bdd2e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:41 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b69e08aa-ba53-4928-8fe1-63df4f6bdd2e Jul 17 19:55:41 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:41 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b69e08aa-ba53-4928-8fe1-63df4f6bdd2e" returned: 0 in 0.271s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.333s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Acquiring lock "cinder-quobyte-25d01e28-a205-4500-85a0-d1d4f603bef4-86ecca8c-18ec-46bc-a181-07d48eac6a98" by "_create_volume_from_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f65937-8805-4b72-b6af-3661729d5615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b69e08aa-ba53-4928-8fe1-63df4f6bdd2e', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6800342c-551a-4d16-b525-e517e49c1ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Lock "cinder-quobyte-25d01e28-a205-4500-85a0-d1d4f603bef4-86ecca8c-18ec-46bc-a181-07d48eac6a98" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Creating volume 86ecca8c-18ec-46bc-a181-07d48eac6a98 from snapshot 25d01e28-a205-4500-85a0-d1d4f603bef4 {{(pid=87726) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Acquiring lock "cinder-quobyte-86ecca8c-18ec-46bc-a181-07d48eac6a98" by "_copy_volume_from_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:41 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] Volume volume-b69e08aa-ba53-4928-8fe1-63df4f6bdd2e (b69e08aa-ba53-4928-8fe1-63df4f6bdd2e): created successfully Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6800342c-551a-4d16-b525-e517e49c1ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] Flow 'volume_create_manager' (846dbeda-1ea5-46f0-b955-6099e348647f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Lock "cinder-quobyte-86ecca8c-18ec-46bc-a181-07d48eac6a98" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] snapshot: 25d01e28-a205-4500-85a0-d1d4f603bef4, volume: 86ecca8c-18ec-46bc-a181-07d48eac6a98, {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 19:55:41 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-c5e4df60-97d3-4468-bd53-9c186f143ee2 tempest-ProjectReaderTests-1558016302 None] Created volume successfully. Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd8c897-920b-4ddd-9986-c1a5d9382d49]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4.25d01e28-a205-4500-85a0-d1d4f603bef4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:42 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4.25d01e28-a205-4500-85a0-d1d4f603bef4 Jul 17 19:55:42 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:42 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4.25d01e28-a205-4500-85a0-d1d4f603bef4" returned: 0 in 0.435s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:42 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:55:42 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4 {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 19:55:42 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Creating direct copy from snapshot {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 19:55:42 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7db2bb8-8dfd-44a0-902f-1b261513bfab]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:42 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4 Jul 17 19:55:42 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:42 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5ba6ff82-546f-4b69-a931-37c16bca9c3a tempest-ProjectReaderTests-1558016302 None] Acquiring lock "cinder-b69e08aa-ba53-4928-8fe1-63df4f6bdd2e-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:42 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5ba6ff82-546f-4b69-a931-37c16bca9c3a tempest-ProjectReaderTests-1558016302 None] Lock "cinder-b69e08aa-ba53-4928-8fe1-63df4f6bdd2e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:42 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5ba6ff82-546f-4b69-a931-37c16bca9c3a tempest-ProjectReaderTests-1558016302 None] Acquiring lock "cinder-quobyte-b69e08aa-ba53-4928-8fe1-63df4f6bdd2e" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:42 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4" returned: 0 in 0.515s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:42 devstack cinder-volume[87726]: DEBUG cinder.utils [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Path /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-86ecca8c-18ec-46bc-a181-07d48eac6a98 not found in is_blk_device check {{(pid=87726) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 19:55:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-86ecca8c-18ec-46bc-a181-07d48eac6a98 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:42 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5ba6ff82-546f-4b69-a931-37c16bca9c3a tempest-ProjectReaderTests-1558016302 None] Lock "cinder-quobyte-b69e08aa-ba53-4928-8fe1-63df4f6bdd2e" acquired by "delete_volume" :: waited 0.039s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:42 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-86ecca8c-18ec-46bc-a181-07d48eac6a98 Jul 17 19:55:42 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:42 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c2c943-13cb-4b2a-a3a6-9248052a0b54]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5ba6ff82-546f-4b69-a931-37c16bca9c3a tempest-ProjectReaderTests-1558016302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b69e08aa-ba53-4928-8fe1-63df4f6bdd2e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:43 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b69e08aa-ba53-4928-8fe1-63df4f6bdd2e Jul 17 19:55:43 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:43 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5ba6ff82-546f-4b69-a931-37c16bca9c3a tempest-ProjectReaderTests-1558016302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b69e08aa-ba53-4928-8fe1-63df4f6bdd2e" returned: 0 in 0.455s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5ba6ff82-546f-4b69-a931-37c16bca9c3a tempest-ProjectReaderTests-1558016302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b69e08aa-ba53-4928-8fe1-63df4f6bdd2e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:43 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b69e08aa-ba53-4928-8fe1-63df4f6bdd2e Jul 17 19:55:43 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:44 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5ba6ff82-546f-4b69-a931-37c16bca9c3a tempest-ProjectReaderTests-1558016302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b69e08aa-ba53-4928-8fe1-63df4f6bdd2e" returned: 0 in 0.735s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:44 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5ba6ff82-546f-4b69-a931-37c16bca9c3a tempest-ProjectReaderTests-1558016302 None] Lock "cinder-quobyte-b69e08aa-ba53-4928-8fe1-63df4f6bdd2e" released by "delete_volume" :: held 1.265s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:44 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-5ba6ff82-546f-4b69-a931-37c16bca9c3a tempest-ProjectReaderTests-1558016302 None] Created reservations ['c953ddbb-5621-44c2-8e24-1044eaa264f3', 'bbaca1c9-908f-4e8b-b4f4-67e5bf1a96cd', '5c791d5d-9658-4a89-9e54-d87ddd568d7e', 'ab613f20-9dfe-4a12-ad69-c2fa23ee5391'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5ba6ff82-546f-4b69-a931-37c16bca9c3a tempest-ProjectReaderTests-1558016302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5ba6ff82-546f-4b69-a931-37c16bca9c3a tempest-ProjectReaderTests-1558016302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5ba6ff82-546f-4b69-a931-37c16bca9c3a tempest-ProjectReaderTests-1558016302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-5ba6ff82-546f-4b69-a931-37c16bca9c3a tempest-ProjectReaderTests-1558016302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5ba6ff82-546f-4b69-a931-37c16bca9c3a tempest-ProjectReaderTests-1558016302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5ba6ff82-546f-4b69-a931-37c16bca9c3a tempest-ProjectReaderTests-1558016302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:44 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:55:44 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:45 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5ba6ff82-546f-4b69-a931-37c16bca9c3a tempest-ProjectReaderTests-1558016302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.685s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:45 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-5ba6ff82-546f-4b69-a931-37c16bca9c3a tempest-ProjectReaderTests-1558016302 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:55:45 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-5ba6ff82-546f-4b69-a931-37c16bca9c3a tempest-ProjectReaderTests-1558016302 None] Deleted volume successfully. Jul 17 19:55:45 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-5ba6ff82-546f-4b69-a931-37c16bca9c3a tempest-ProjectReaderTests-1558016302 None] Lock "cinder-b69e08aa-ba53-4928-8fe1-63df4f6bdd2e-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:46 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:55:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] Flow 'volume_create_manager' (90e592b6-1d43-48ff-b994-3bb5b0aefbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18ba910-6c41-4c04-b8f2-027933a5dbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18ba910-6c41-4c04-b8f2-027933a5dbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1915990626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f184c395-8a42-49c3-88f0-3ef95ae1c923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a961f6d6198c4d7b965c7b648e811847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:46Z,use_quota=True,user_id='1bbf0336f6864f9095c7c9500272fb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (739b4975-1a11-4465-b06a-70e158fb100e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (739b4975-1a11-4465-b06a-70e158fb100e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd5f9eeb-97f9-48a9-925f-16d0d4e8bbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd5f9eeb-97f9-48a9-925f-16d0d4e8bbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f184c395-8a42-49c3-88f0-3ef95ae1c923', 'volume_name': 'volume-f184c395-8a42-49c3-88f0-3ef95ae1c923', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d079fc94-f50c-4677-8835-6f900674230c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d079fc94-f50c-4677-8835-6f900674230c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:46 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dff638db-3adb-4f04-8894-e47f8efc7745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:46 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] Volume f184c395-8a42-49c3-88f0-3ef95ae1c923: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f184c395-8a42-49c3-88f0-3ef95ae1c923', 'volume_size': 1} Jul 17 19:55:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:48 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-86ecca8c-18ec-46bc-a181-07d48eac6a98" returned: 0 in 5.812s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:48 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42edb39-2c4c-4c80-ab3c-9bdb958433f4]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:48 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4 Jul 17 19:55:48 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:48 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:UPDATE=270,cinder:SELECT=222,cinder:INSERT=85,cinder:DELETE=22 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:55:48 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=191,cinder:UPDATE=304,cinder:DELETE=30,cinder:INSERT=66 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] Flow 'volume_create_manager' (f1862b9b-4a37-401a-93a3-c5ae7be57f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d569a98-7972-4d18-9a08-f435aff7ebc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d569a98-7972-4d18-9a08-f435aff7ebc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1520365692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff3ebb3-67a5-4fc9-83f9-de58e6bbf9ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='452670c1b5f249049192d093b42b91c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:49Z,use_quota=True,user_id='f25475e5020c4ac384ddfdc784dd8e26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2309d091-30d5-45cf-a93f-f8c32575ff37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2309d091-30d5-45cf-a93f-f8c32575ff37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6a4d11-9e56-4f80-863b-85a213ed0248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6a4d11-9e56-4f80-863b-85a213ed0248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eff3ebb3-67a5-4fc9-83f9-de58e6bbf9ec', 'volume_name': 'volume-eff3ebb3-67a5-4fc9-83f9-de58e6bbf9ec', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f4a0e45-3b5f-42b1-82c8-f18c42b25816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f4a0e45-3b5f-42b1-82c8-f18c42b25816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f4442b2-4188-41f3-9108-67e4044eef67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:49 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] Volume eff3ebb3-67a5-4fc9-83f9-de58e6bbf9ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eff3ebb3-67a5-4fc9-83f9-de58e6bbf9ec', 'volume_size': 1} Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:49 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4" returned: 0 in 0.618s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Image conversion details: src /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4, size 1024.00 MB, duration 5.81 sec, destination /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-86ecca8c-18ec-46bc-a181-07d48eac6a98 {{(pid=87726) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 19:55:49 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Converted 1024.00 MB image at 176.17 MB/s Jul 17 19:55:49 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-86ecca8c-18ec-46bc-a181-07d48eac6a98 is being set with open permissions: ugo+rw Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-86ecca8c-18ec-46bc-a181-07d48eac6a98 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:49 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-86ecca8c-18ec-46bc-a181-07d48eac6a98 Jul 17 19:55:49 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:49 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-86ecca8c-18ec-46bc-a181-07d48eac6a98" returned: 0 in 0.259s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Lock "cinder-quobyte-86ecca8c-18ec-46bc-a181-07d48eac6a98" released by "_copy_volume_from_snapshot" :: held 7.757s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Lock "cinder-quobyte-25d01e28-a205-4500-85a0-d1d4f603bef4-86ecca8c-18ec-46bc-a181-07d48eac6a98" released by "_create_volume_from_snapshot" :: held 7.816s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.858s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.769s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1915990626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f184c395-8a42-49c3-88f0-3ef95ae1c923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a961f6d6198c4d7b965c7b648e811847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:46Z,use_quota=True,user_id='1bbf0336f6864f9095c7c9500272fb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] Creating volume f184c395-8a42-49c3-88f0-3ef95ae1c923 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:55:49 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f184c395-8a42-49c3-88f0-3ef95ae1c923 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:49 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f184c395-8a42-49c3-88f0-3ef95ae1c923 1073741824 Jul 17 19:55:49 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (551da8b2-ffda-4443-9ff1-54b781b8a2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86ecca8c-18ec-46bc-a181-07d48eac6a98', 'volume_size': 1, 'snapshot_id': '25d01e28-a205-4500-85a0-d1d4f603bef4'}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d75b2a7d-e7a5-46dd-a814-3f0f2b6a7123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:49 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Volume volume-86ecca8c-18ec-46bc-a181-07d48eac6a98 (86ecca8c-18ec-46bc-a181-07d48eac6a98): created successfully Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d75b2a7d-e7a5-46dd-a814-3f0f2b6a7123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:49 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Flow 'volume_create_manager' (b96ae2b7-faf8-4791-96d9-7051e4ef7e4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:49 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-9832bb82-fee3-44a6-82b1-34a1354f0cd3 tempest-VolumeDependencyTests-144218068 None] Created volume successfully. Jul 17 19:55:50 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f184c395-8a42-49c3-88f0-3ef95ae1c923 1073741824" returned: 0 in 0.452s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f184c395-8a42-49c3-88f0-3ef95ae1c923 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:50 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f184c395-8a42-49c3-88f0-3ef95ae1c923 Jul 17 19:55:50 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:50 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f184c395-8a42-49c3-88f0-3ef95ae1c923" returned: 0 in 0.261s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.270s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1520365692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff3ebb3-67a5-4fc9-83f9-de58e6bbf9ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='452670c1b5f249049192d093b42b91c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:49Z,use_quota=True,user_id='f25475e5020c4ac384ddfdc784dd8e26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] Creating volume eff3ebb3-67a5-4fc9-83f9-de58e6bbf9ec {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:55:50 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-eff3ebb3-67a5-4fc9-83f9-de58e6bbf9ec 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ab0d3118-35e2-4ed1-8df3-e1363affc887 tempest-VolumeDependencyTests-144218068 None] Acquiring lock "cinder-25d01e28-a205-4500-85a0-d1d4f603bef4-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dff638db-3adb-4f04-8894-e47f8efc7745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f184c395-8a42-49c3-88f0-3ef95ae1c923', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:50 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-eff3ebb3-67a5-4fc9-83f9-de58e6bbf9ec 1073741824 Jul 17 19:55:50 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95faf372-5aa8-44f4-987b-6bdd79f32712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:50 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] Volume volume-f184c395-8a42-49c3-88f0-3ef95ae1c923 (f184c395-8a42-49c3-88f0-3ef95ae1c923): created successfully Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95faf372-5aa8-44f4-987b-6bdd79f32712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] Flow 'volume_create_manager' (90e592b6-1d43-48ff-b994-3bb5b0aefbf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ab0d3118-35e2-4ed1-8df3-e1363affc887 tempest-VolumeDependencyTests-144218068 None] Lock "cinder-25d01e28-a205-4500-85a0-d1d4f603bef4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ab0d3118-35e2-4ed1-8df3-e1363affc887 tempest-VolumeDependencyTests-144218068 None] Acquiring lock "cinder-quobyte-6bb80a8f-5284-4bf0-9216-0108bf26d6d4" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:50 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-d6eac099-e3a9-41a4-9114-2f33f2b4ab67 tempest-ProjectReaderTests-1558016302 None] Created volume successfully. Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ab0d3118-35e2-4ed1-8df3-e1363affc887 tempest-VolumeDependencyTests-144218068 None] Lock "cinder-quobyte-6bb80a8f-5284-4bf0-9216-0108bf26d6d4" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ab0d3118-35e2-4ed1-8df3-e1363affc887 tempest-VolumeDependencyTests-144218068 None] Acquiring lock "cinder-quobyte-25d01e28-a205-4500-85a0-d1d4f603bef4" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ab0d3118-35e2-4ed1-8df3-e1363affc887 tempest-VolumeDependencyTests-144218068 None] Lock "cinder-quobyte-25d01e28-a205-4500-85a0-d1d4f603bef4" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-ab0d3118-35e2-4ed1-8df3-e1363affc887 tempest-VolumeDependencyTests-144218068 None] Deleting offline snapshot 25d01e28-a205-4500-85a0-d1d4f603bef4 of volume 6bb80a8f-5284-4bf0-9216-0108bf26d6d4 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-ab0d3118-35e2-4ed1-8df3-e1363affc887 tempest-VolumeDependencyTests-144218068 None] snapshot_file for this snap is: volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4.25d01e28-a205-4500-85a0-d1d4f603bef4 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[56735642-f2f3-4d4e-b883-4e69cf251f38]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ab0d3118-35e2-4ed1-8df3-e1363affc887 tempest-VolumeDependencyTests-144218068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4.25d01e28-a205-4500-85a0-d1d4f603bef4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:50 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4.25d01e28-a205-4500-85a0-d1d4f603bef4 Jul 17 19:55:50 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-4f3c85bf-907e-4bb2-90c8-1bd837105f31 tempest-ProjectReaderTests-1558016302 None] Acquiring lock "cinder-f184c395-8a42-49c3-88f0-3ef95ae1c923-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-4f3c85bf-907e-4bb2-90c8-1bd837105f31 tempest-ProjectReaderTests-1558016302 None] Lock "cinder-f184c395-8a42-49c3-88f0-3ef95ae1c923-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-4f3c85bf-907e-4bb2-90c8-1bd837105f31 tempest-ProjectReaderTests-1558016302 None] Acquiring lock "cinder-quobyte-f184c395-8a42-49c3-88f0-3ef95ae1c923" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-4f3c85bf-907e-4bb2-90c8-1bd837105f31 tempest-ProjectReaderTests-1558016302 None] Lock "cinder-quobyte-f184c395-8a42-49c3-88f0-3ef95ae1c923" acquired by "delete_volume" :: waited 0.026s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:50 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-eff3ebb3-67a5-4fc9-83f9-de58e6bbf9ec 1073741824" returned: 0 in 0.600s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:51 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd28692-0f5c-4d41-974a-f0986523bda3]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4f3c85bf-907e-4bb2-90c8-1bd837105f31 tempest-ProjectReaderTests-1558016302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f184c395-8a42-49c3-88f0-3ef95ae1c923 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:51 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ab0d3118-35e2-4ed1-8df3-e1363affc887 tempest-VolumeDependencyTests-144218068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4.25d01e28-a205-4500-85a0-d1d4f603bef4" returned: 0 in 0.467s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:51 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-ab0d3118-35e2-4ed1-8df3-e1363affc887 tempest-VolumeDependencyTests-144218068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:55:51 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6b5612-b49e-4f0d-abb8-0a8e72af0725]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ab0d3118-35e2-4ed1-8df3-e1363affc887 tempest-VolumeDependencyTests-144218068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-eff3ebb3-67a5-4fc9-83f9-de58e6bbf9ec {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:51 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-eff3ebb3-67a5-4fc9-83f9-de58e6bbf9ec Jul 17 19:55:51 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:51 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f184c395-8a42-49c3-88f0-3ef95ae1c923 Jul 17 19:55:51 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:51 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4 Jul 17 19:55:51 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:51 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-eff3ebb3-67a5-4fc9-83f9-de58e6bbf9ec" returned: 0 in 0.308s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:51 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:55:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f4442b2-4188-41f3-9108-67e4044eef67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eff3ebb3-67a5-4fc9-83f9-de58e6bbf9ec', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:51 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa5c154-7832-4121-9e9f-85825044a321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4f3c85bf-907e-4bb2-90c8-1bd837105f31 tempest-ProjectReaderTests-1558016302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f184c395-8a42-49c3-88f0-3ef95ae1c923" returned: 0 in 0.404s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4f3c85bf-907e-4bb2-90c8-1bd837105f31 tempest-ProjectReaderTests-1558016302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f184c395-8a42-49c3-88f0-3ef95ae1c923 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:51 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] Volume volume-eff3ebb3-67a5-4fc9-83f9-de58e6bbf9ec (eff3ebb3-67a5-4fc9-83f9-de58e6bbf9ec): created successfully Jul 17 19:55:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa5c154-7832-4121-9e9f-85825044a321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:51 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f184c395-8a42-49c3-88f0-3ef95ae1c923 Jul 17 19:55:51 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] Flow 'volume_create_manager' (f1862b9b-4a37-401a-93a3-c5ae7be57f03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:51 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-ba5eb193-c4ef-4885-880a-cfdab00e721b tempest-ProjectReaderTests-120066846 None] Created volume successfully. Jul 17 19:55:51 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ab0d3118-35e2-4ed1-8df3-e1363affc887 tempest-VolumeDependencyTests-144218068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4" returned: 0 in 0.447s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ab0d3118-35e2-4ed1-8df3-e1363affc887 tempest-VolumeDependencyTests-144218068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4.25d01e28-a205-4500-85a0-d1d4f603bef4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:51 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4.25d01e28-a205-4500-85a0-d1d4f603bef4 Jul 17 19:55:51 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:51 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4f3c85bf-907e-4bb2-90c8-1bd837105f31 tempest-ProjectReaderTests-1558016302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-f184c395-8a42-49c3-88f0-3ef95ae1c923" returned: 0 in 0.301s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:51 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-4f3c85bf-907e-4bb2-90c8-1bd837105f31 tempest-ProjectReaderTests-1558016302 None] Lock "cinder-quobyte-f184c395-8a42-49c3-88f0-3ef95ae1c923" released by "delete_volume" :: held 0.768s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:51 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-4f3c85bf-907e-4bb2-90c8-1bd837105f31 tempest-ProjectReaderTests-1558016302 None] Created reservations ['4417bd2a-a457-4d76-a731-e140a4063adc', '76107952-98ab-4019-b447-94d190076e7f', 'e40b6e6b-3b57-41d6-9cb6-8b1e6b96573e', '97e0b0f3-f964-45fb-aa95-6660e9292b3b'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4f3c85bf-907e-4bb2-90c8-1bd837105f31 tempest-ProjectReaderTests-1558016302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4f3c85bf-907e-4bb2-90c8-1bd837105f31 tempest-ProjectReaderTests-1558016302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:51 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4f3c85bf-907e-4bb2-90c8-1bd837105f31 tempest-ProjectReaderTests-1558016302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:51 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:51 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4f3c85bf-907e-4bb2-90c8-1bd837105f31 tempest-ProjectReaderTests-1558016302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4f3c85bf-907e-4bb2-90c8-1bd837105f31 tempest-ProjectReaderTests-1558016302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4f3c85bf-907e-4bb2-90c8-1bd837105f31 tempest-ProjectReaderTests-1558016302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ab0d3118-35e2-4ed1-8df3-e1363affc887 tempest-VolumeDependencyTests-144218068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4.25d01e28-a205-4500-85a0-d1d4f603bef4" returned: 0 in 0.372s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ab0d3118-35e2-4ed1-8df3-e1363affc887 tempest-VolumeDependencyTests-144218068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4.25d01e28-a205-4500-85a0-d1d4f603bef4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:51 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:55:51 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:51 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4.25d01e28-a205-4500-85a0-d1d4f603bef4 Jul 17 19:55:51 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:52 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4f3c85bf-907e-4bb2-90c8-1bd837105f31 tempest-ProjectReaderTests-1558016302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.289s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:52 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-4f3c85bf-907e-4bb2-90c8-1bd837105f31 tempest-ProjectReaderTests-1558016302 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:55:52 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-4f3c85bf-907e-4bb2-90c8-1bd837105f31 tempest-ProjectReaderTests-1558016302 None] Deleted volume successfully. Jul 17 19:55:52 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ab0d3118-35e2-4ed1-8df3-e1363affc887 tempest-VolumeDependencyTests-144218068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4.25d01e28-a205-4500-85a0-d1d4f603bef4" returned: 0 in 0.319s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:52 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-4f3c85bf-907e-4bb2-90c8-1bd837105f31 tempest-ProjectReaderTests-1558016302 None] Lock "cinder-f184c395-8a42-49c3-88f0-3ef95ae1c923-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:52 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ab0d3118-35e2-4ed1-8df3-e1363affc887 tempest-VolumeDependencyTests-144218068 None] Lock "cinder-quobyte-25d01e28-a205-4500-85a0-d1d4f603bef4" released by "_delete_snapshot" :: held 1.725s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:52 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ab0d3118-35e2-4ed1-8df3-e1363affc887 tempest-VolumeDependencyTests-144218068 None] Lock "cinder-quobyte-6bb80a8f-5284-4bf0-9216-0108bf26d6d4" released by "delete_snapshot" :: held 1.757s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:52 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-ab0d3118-35e2-4ed1-8df3-e1363affc887 tempest-VolumeDependencyTests-144218068 None] Created reservations ['aa543ad3-a076-4a43-8434-3ec791e9dcaa', '3dfda95c-081c-412a-a63e-75c184dc7c21', '782aabdd-3f2f-412f-8417-7d46eb29b00b', 'b9507a7b-9924-4214-b3e6-b35f0027a4e5'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:52 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f802ebbf-0ef4-4de0-b910-d6bcc237e957 tempest-ProjectReaderTests-120066846 None] Acquiring lock "cinder-eff3ebb3-67a5-4fc9-83f9-de58e6bbf9ec-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:52 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-ab0d3118-35e2-4ed1-8df3-e1363affc887 tempest-VolumeDependencyTests-144218068 None] Delete snapshot completed successfully. Jul 17 19:55:52 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f802ebbf-0ef4-4de0-b910-d6bcc237e957 tempest-ProjectReaderTests-120066846 None] Lock "cinder-eff3ebb3-67a5-4fc9-83f9-de58e6bbf9ec-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:52 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ab0d3118-35e2-4ed1-8df3-e1363affc887 tempest-VolumeDependencyTests-144218068 None] Lock "cinder-25d01e28-a205-4500-85a0-d1d4f603bef4-delete_snapshot" released by "delete_snapshot" :: held 1.966s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:52 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f802ebbf-0ef4-4de0-b910-d6bcc237e957 tempest-ProjectReaderTests-120066846 None] Acquiring lock "cinder-quobyte-eff3ebb3-67a5-4fc9-83f9-de58e6bbf9ec" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:52 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f802ebbf-0ef4-4de0-b910-d6bcc237e957 tempest-ProjectReaderTests-120066846 None] Lock "cinder-quobyte-eff3ebb3-67a5-4fc9-83f9-de58e6bbf9ec" acquired by "delete_volume" :: waited 0.028s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:52 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc9b377-1de6-437f-8aaa-7d98fc2610ec]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f802ebbf-0ef4-4de0-b910-d6bcc237e957 tempest-ProjectReaderTests-120066846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-eff3ebb3-67a5-4fc9-83f9-de58e6bbf9ec {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:52 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7e5ba78a-4ec5-4315-b04a-64f6483055b8 tempest-VolumeDependencyTests-144218068 None] Acquiring lock "cinder-6bb80a8f-5284-4bf0-9216-0108bf26d6d4-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:52 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7e5ba78a-4ec5-4315-b04a-64f6483055b8 tempest-VolumeDependencyTests-144218068 None] Lock "cinder-6bb80a8f-5284-4bf0-9216-0108bf26d6d4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:52 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7e5ba78a-4ec5-4315-b04a-64f6483055b8 tempest-VolumeDependencyTests-144218068 None] Acquiring lock "cinder-quobyte-6bb80a8f-5284-4bf0-9216-0108bf26d6d4" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:52 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7e5ba78a-4ec5-4315-b04a-64f6483055b8 tempest-VolumeDependencyTests-144218068 None] Lock "cinder-quobyte-6bb80a8f-5284-4bf0-9216-0108bf26d6d4" acquired by "delete_volume" :: waited 0.024s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:52 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-eff3ebb3-67a5-4fc9-83f9-de58e6bbf9ec Jul 17 19:55:52 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:52 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b543211-a662-4185-9e2f-2e6e5ca19f52]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7e5ba78a-4ec5-4315-b04a-64f6483055b8 tempest-VolumeDependencyTests-144218068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:52 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4 Jul 17 19:55:52 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:53 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f802ebbf-0ef4-4de0-b910-d6bcc237e957 tempest-ProjectReaderTests-120066846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-eff3ebb3-67a5-4fc9-83f9-de58e6bbf9ec" returned: 0 in 0.505s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f802ebbf-0ef4-4de0-b910-d6bcc237e957 tempest-ProjectReaderTests-120066846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-eff3ebb3-67a5-4fc9-83f9-de58e6bbf9ec {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:53 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-eff3ebb3-67a5-4fc9-83f9-de58e6bbf9ec Jul 17 19:55:53 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:53 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7e5ba78a-4ec5-4315-b04a-64f6483055b8 tempest-VolumeDependencyTests-144218068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4" returned: 0 in 0.439s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7e5ba78a-4ec5-4315-b04a-64f6483055b8 tempest-VolumeDependencyTests-144218068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:53 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4 Jul 17 19:55:53 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:53 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f802ebbf-0ef4-4de0-b910-d6bcc237e957 tempest-ProjectReaderTests-120066846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-eff3ebb3-67a5-4fc9-83f9-de58e6bbf9ec" returned: 0 in 0.307s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:53 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f802ebbf-0ef4-4de0-b910-d6bcc237e957 tempest-ProjectReaderTests-120066846 None] Lock "cinder-quobyte-eff3ebb3-67a5-4fc9-83f9-de58e6bbf9ec" released by "delete_volume" :: held 0.863s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:53 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-f802ebbf-0ef4-4de0-b910-d6bcc237e957 tempest-ProjectReaderTests-120066846 None] Created reservations ['f2e0a7b0-33e1-46cd-bf92-4dd880538af4', '29dc361a-5a24-4b26-9438-bf77180a9455', 'c90fff97-d26e-4170-849c-9e150151542a', 'cf100923-684d-4812-8dcb-ffc36ebf7dd7'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f802ebbf-0ef4-4de0-b910-d6bcc237e957 tempest-ProjectReaderTests-120066846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f802ebbf-0ef4-4de0-b910-d6bcc237e957 tempest-ProjectReaderTests-120066846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:53 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-f802ebbf-0ef4-4de0-b910-d6bcc237e957 tempest-ProjectReaderTests-120066846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:53 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-f802ebbf-0ef4-4de0-b910-d6bcc237e957 tempest-ProjectReaderTests-120066846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f802ebbf-0ef4-4de0-b910-d6bcc237e957 tempest-ProjectReaderTests-120066846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f802ebbf-0ef4-4de0-b910-d6bcc237e957 tempest-ProjectReaderTests-120066846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:53 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:55:53 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:53 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7e5ba78a-4ec5-4315-b04a-64f6483055b8 tempest-VolumeDependencyTests-144218068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-6bb80a8f-5284-4bf0-9216-0108bf26d6d4" returned: 0 in 0.454s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:53 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7e5ba78a-4ec5-4315-b04a-64f6483055b8 tempest-VolumeDependencyTests-144218068 None] Lock "cinder-quobyte-6bb80a8f-5284-4bf0-9216-0108bf26d6d4" released by "delete_volume" :: held 0.997s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:53 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-7e5ba78a-4ec5-4315-b04a-64f6483055b8 tempest-VolumeDependencyTests-144218068 None] Created reservations ['92bd399d-ff6f-4f2c-b058-8231100923ee', 'a82d185d-414b-41b8-afea-7b4ae365d47a', '77cee320-eeb6-4bce-a44a-72a6e878166a', '726ba80f-f583-4dfc-b30b-b3860f5e4f22'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7e5ba78a-4ec5-4315-b04a-64f6483055b8 tempest-VolumeDependencyTests-144218068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7e5ba78a-4ec5-4315-b04a-64f6483055b8 tempest-VolumeDependencyTests-144218068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:53 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7e5ba78a-4ec5-4315-b04a-64f6483055b8 tempest-VolumeDependencyTests-144218068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:53 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7e5ba78a-4ec5-4315-b04a-64f6483055b8 tempest-VolumeDependencyTests-144218068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7e5ba78a-4ec5-4315-b04a-64f6483055b8 tempest-VolumeDependencyTests-144218068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7e5ba78a-4ec5-4315-b04a-64f6483055b8 tempest-VolumeDependencyTests-144218068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:53 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:55:53 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:53 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f802ebbf-0ef4-4de0-b910-d6bcc237e957 tempest-ProjectReaderTests-120066846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.458s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:53 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-f802ebbf-0ef4-4de0-b910-d6bcc237e957 tempest-ProjectReaderTests-120066846 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:55:53 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-f802ebbf-0ef4-4de0-b910-d6bcc237e957 tempest-ProjectReaderTests-120066846 None] Deleted volume successfully. Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f802ebbf-0ef4-4de0-b910-d6bcc237e957 tempest-ProjectReaderTests-120066846 None] Lock "cinder-eff3ebb3-67a5-4fc9-83f9-de58e6bbf9ec-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:54 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7e5ba78a-4ec5-4315-b04a-64f6483055b8 tempest-VolumeDependencyTests-144218068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.432s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-7e5ba78a-4ec5-4315-b04a-64f6483055b8 tempest-VolumeDependencyTests-144218068 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:55:54 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-7e5ba78a-4ec5-4315-b04a-64f6483055b8 tempest-VolumeDependencyTests-144218068 None] Deleted volume successfully. Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7e5ba78a-4ec5-4315-b04a-64f6483055b8 tempest-VolumeDependencyTests-144218068 None] Lock "cinder-6bb80a8f-5284-4bf0-9216-0108bf26d6d4-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] Flow 'volume_create_manager' (eb1989c2-df2b-40af-b792-80d4ff7e43a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0cd7ec2-803a-4c51-8f02-d1dc4fee59f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0cd7ec2-803a-4c51-8f02-d1dc4fee59f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-425183554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab5c066-bbf6-4d8c-91cb-83cffaf1158c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='452670c1b5f249049192d093b42b91c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:54Z,use_quota=True,user_id='f25475e5020c4ac384ddfdc784dd8e26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79309440-185a-41ec-a01b-c8b788f4dcf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79309440-185a-41ec-a01b-c8b788f4dcf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0257a171-71cc-4d75-aa37-b22bb4793f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0257a171-71cc-4d75-aa37-b22bb4793f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ab5c066-bbf6-4d8c-91cb-83cffaf1158c', 'volume_name': 'volume-4ab5c066-bbf6-4d8c-91cb-83cffaf1158c', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (868a9c2d-005e-423b-b64d-f0f829300f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (868a9c2d-005e-423b-b64d-f0f829300f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ebbc8d8-8c28-401c-8fe3-fde4f5f5dd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:54 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] Volume 4ab5c066-bbf6-4d8c-91cb-83cffaf1158c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ab5c066-bbf6-4d8c-91cb-83cffaf1158c', 'volume_size': 1} Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-425183554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab5c066-bbf6-4d8c-91cb-83cffaf1158c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='452670c1b5f249049192d093b42b91c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:54Z,use_quota=True,user_id='f25475e5020c4ac384ddfdc784dd8e26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] Creating volume 4ab5c066-bbf6-4d8c-91cb-83cffaf1158c {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:55:54 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4ab5c066-bbf6-4d8c-91cb-83cffaf1158c 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:54 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4ab5c066-bbf6-4d8c-91cb-83cffaf1158c 1073741824 Jul 17 19:55:54 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-583d8ead-7269-42a6-bd4f-244d01ba89f7 tempest-VolumeDependencyTests-144218068 None] Acquiring lock "cinder-86ecca8c-18ec-46bc-a181-07d48eac6a98-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-583d8ead-7269-42a6-bd4f-244d01ba89f7 tempest-VolumeDependencyTests-144218068 None] Lock "cinder-86ecca8c-18ec-46bc-a181-07d48eac6a98-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-583d8ead-7269-42a6-bd4f-244d01ba89f7 tempest-VolumeDependencyTests-144218068 None] Acquiring lock "cinder-quobyte-86ecca8c-18ec-46bc-a181-07d48eac6a98" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-583d8ead-7269-42a6-bd4f-244d01ba89f7 tempest-VolumeDependencyTests-144218068 None] Lock "cinder-quobyte-86ecca8c-18ec-46bc-a181-07d48eac6a98" acquired by "delete_volume" :: waited 0.019s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[43edf4d5-5eb5-4d30-8203-02b102034a83]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-583d8ead-7269-42a6-bd4f-244d01ba89f7 tempest-VolumeDependencyTests-144218068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-86ecca8c-18ec-46bc-a181-07d48eac6a98 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:55 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4ab5c066-bbf6-4d8c-91cb-83cffaf1158c 1073741824" returned: 0 in 0.533s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4ab5c066-bbf6-4d8c-91cb-83cffaf1158c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:55 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4ab5c066-bbf6-4d8c-91cb-83cffaf1158c Jul 17 19:55:55 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:55 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-86ecca8c-18ec-46bc-a181-07d48eac6a98 Jul 17 19:55:55 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:55 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4ab5c066-bbf6-4d8c-91cb-83cffaf1158c" returned: 0 in 0.282s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:55 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:55:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ebbc8d8-8c28-401c-8fe3-fde4f5f5dd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ab5c066-bbf6-4d8c-91cb-83cffaf1158c', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85510976-ed0b-4278-8da4-bc28e2b6f11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:55 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] Volume volume-4ab5c066-bbf6-4d8c-91cb-83cffaf1158c (4ab5c066-bbf6-4d8c-91cb-83cffaf1158c): created successfully Jul 17 19:55:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85510976-ed0b-4278-8da4-bc28e2b6f11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:55 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] Flow 'volume_create_manager' (eb1989c2-df2b-40af-b792-80d4ff7e43a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:55 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-6cba175a-9338-4d00-9d3e-f7403f9c5d8f tempest-ProjectReaderTests-120066846 None] Created volume successfully. Jul 17 19:55:55 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-583d8ead-7269-42a6-bd4f-244d01ba89f7 tempest-VolumeDependencyTests-144218068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-86ecca8c-18ec-46bc-a181-07d48eac6a98" returned: 0 in 0.441s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-583d8ead-7269-42a6-bd4f-244d01ba89f7 tempest-VolumeDependencyTests-144218068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-86ecca8c-18ec-46bc-a181-07d48eac6a98 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:55 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-86ecca8c-18ec-46bc-a181-07d48eac6a98 Jul 17 19:55:55 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:55 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-583d8ead-7269-42a6-bd4f-244d01ba89f7 tempest-VolumeDependencyTests-144218068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-86ecca8c-18ec-46bc-a181-07d48eac6a98" returned: 0 in 0.265s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:55 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-583d8ead-7269-42a6-bd4f-244d01ba89f7 tempest-VolumeDependencyTests-144218068 None] Lock "cinder-quobyte-86ecca8c-18ec-46bc-a181-07d48eac6a98" released by "delete_volume" :: held 0.751s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:55 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-583d8ead-7269-42a6-bd4f-244d01ba89f7 tempest-VolumeDependencyTests-144218068 None] Created reservations ['bfcaacee-ff84-4026-9021-5a47de2f36c4', 'aeb052a0-bf0f-405d-b4ac-ecfb1e38d190', '8d8fd4f2-6985-4cc7-bc46-1477a8a894c9', '1476b7f1-c372-4015-bf8d-845a58e1be26'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-583d8ead-7269-42a6-bd4f-244d01ba89f7 tempest-VolumeDependencyTests-144218068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-583d8ead-7269-42a6-bd4f-244d01ba89f7 tempest-VolumeDependencyTests-144218068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:55 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-583d8ead-7269-42a6-bd4f-244d01ba89f7 tempest-VolumeDependencyTests-144218068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:55 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-583d8ead-7269-42a6-bd4f-244d01ba89f7 tempest-VolumeDependencyTests-144218068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-583d8ead-7269-42a6-bd4f-244d01ba89f7 tempest-VolumeDependencyTests-144218068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-583d8ead-7269-42a6-bd4f-244d01ba89f7 tempest-VolumeDependencyTests-144218068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:55 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:55:55 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:56 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-583d8ead-7269-42a6-bd4f-244d01ba89f7 tempest-VolumeDependencyTests-144218068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.259s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:56 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-583d8ead-7269-42a6-bd4f-244d01ba89f7 tempest-VolumeDependencyTests-144218068 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:55:56 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-583d8ead-7269-42a6-bd4f-244d01ba89f7 tempest-VolumeDependencyTests-144218068 None] Deleted volume successfully. Jul 17 19:55:56 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-583d8ead-7269-42a6-bd4f-244d01ba89f7 tempest-VolumeDependencyTests-144218068 None] Lock "cinder-86ecca8c-18ec-46bc-a181-07d48eac6a98-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:56 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-48411da5-5fbd-4b65-9385-dc99555ac650 tempest-ProjectReaderTests-120066846 None] Acquiring lock "cinder-4ab5c066-bbf6-4d8c-91cb-83cffaf1158c-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:56 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-48411da5-5fbd-4b65-9385-dc99555ac650 tempest-ProjectReaderTests-120066846 None] Lock "cinder-4ab5c066-bbf6-4d8c-91cb-83cffaf1158c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:56 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-48411da5-5fbd-4b65-9385-dc99555ac650 tempest-ProjectReaderTests-120066846 None] Acquiring lock "cinder-quobyte-4ab5c066-bbf6-4d8c-91cb-83cffaf1158c" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:55:56 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-48411da5-5fbd-4b65-9385-dc99555ac650 tempest-ProjectReaderTests-120066846 None] Lock "cinder-quobyte-4ab5c066-bbf6-4d8c-91cb-83cffaf1158c" acquired by "delete_volume" :: waited 0.030s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:55:56 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26f505b-9f80-4a7c-998d-b769e3800269]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:55:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-48411da5-5fbd-4b65-9385-dc99555ac650 tempest-ProjectReaderTests-120066846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4ab5c066-bbf6-4d8c-91cb-83cffaf1158c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:56 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4ab5c066-bbf6-4d8c-91cb-83cffaf1158c Jul 17 19:55:56 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:56 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-48411da5-5fbd-4b65-9385-dc99555ac650 tempest-ProjectReaderTests-120066846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4ab5c066-bbf6-4d8c-91cb-83cffaf1158c" returned: 0 in 0.412s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-48411da5-5fbd-4b65-9385-dc99555ac650 tempest-ProjectReaderTests-120066846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4ab5c066-bbf6-4d8c-91cb-83cffaf1158c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:57 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4ab5c066-bbf6-4d8c-91cb-83cffaf1158c Jul 17 19:55:57 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:57 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-48411da5-5fbd-4b65-9385-dc99555ac650 tempest-ProjectReaderTests-120066846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-4ab5c066-bbf6-4d8c-91cb-83cffaf1158c" returned: 0 in 0.262s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:57 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-48411da5-5fbd-4b65-9385-dc99555ac650 tempest-ProjectReaderTests-120066846 None] Lock "cinder-quobyte-4ab5c066-bbf6-4d8c-91cb-83cffaf1158c" released by "delete_volume" :: held 0.729s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:57 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-48411da5-5fbd-4b65-9385-dc99555ac650 tempest-ProjectReaderTests-120066846 None] Created reservations ['c1815b6e-0f21-46c2-8674-ef0367dfaf06', '7aae20e2-917d-486a-8648-a85ba45095ef', '466a2b3a-dc92-45bc-a8b6-b086bf3e0b12', 'c6489ace-78e4-431e-9d03-e499afdfdbcc'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:55:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-48411da5-5fbd-4b65-9385-dc99555ac650 tempest-ProjectReaderTests-120066846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-48411da5-5fbd-4b65-9385-dc99555ac650 tempest-ProjectReaderTests-120066846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:57 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-48411da5-5fbd-4b65-9385-dc99555ac650 tempest-ProjectReaderTests-120066846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:57 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-48411da5-5fbd-4b65-9385-dc99555ac650 tempest-ProjectReaderTests-120066846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-48411da5-5fbd-4b65-9385-dc99555ac650 tempest-ProjectReaderTests-120066846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-48411da5-5fbd-4b65-9385-dc99555ac650 tempest-ProjectReaderTests-120066846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:57 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:55:57 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:57 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-48411da5-5fbd-4b65-9385-dc99555ac650 tempest-ProjectReaderTests-120066846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.323s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:57 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-48411da5-5fbd-4b65-9385-dc99555ac650 tempest-ProjectReaderTests-120066846 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:55:57 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-48411da5-5fbd-4b65-9385-dc99555ac650 tempest-ProjectReaderTests-120066846 None] Deleted volume successfully. Jul 17 19:55:57 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-48411da5-5fbd-4b65-9385-dc99555ac650 tempest-ProjectReaderTests-120066846 None] Lock "cinder-4ab5c066-bbf6-4d8c-91cb-83cffaf1158c-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:55:57 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:55:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] Flow 'volume_create_manager' (7a009238-bcda-493c-ae0f-031f735d980d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb2d6585-0d18-4e9f-8e3c-b85b1418b298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb2d6585-0d18-4e9f-8e3c-b85b1418b298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-559390358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb68a5c-d2e6-4866-8771-76e3d28b5b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='292c7664e8d0464b8d760da18a48ef96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:58Z,use_quota=True,user_id='2116daf9106f417f838ea1e496129378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94cb39a7-2c3c-44e0-b9a7-da79d9dc065c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94cb39a7-2c3c-44e0-b9a7-da79d9dc065c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86eac2e5-a11e-46e7-960e-9a73f9121c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86eac2e5-a11e-46e7-960e-9a73f9121c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edb68a5c-d2e6-4866-8771-76e3d28b5b57', 'volume_name': 'volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9368fc0-282f-4db3-8575-1b504e85e3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9368fc0-282f-4db3-8575-1b504e85e3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae3f4909-a87a-47e0-9287-5e73c8657ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:58 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] Volume edb68a5c-d2e6-4866-8771-76e3d28b5b57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57', 'volume_size': 1} Jul 17 19:55:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-559390358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb68a5c-d2e6-4866-8771-76e3d28b5b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='292c7664e8d0464b8d760da18a48ef96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:55:58Z,use_quota=True,user_id='2116daf9106f417f838ea1e496129378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:55:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] Creating volume edb68a5c-d2e6-4866-8771-76e3d28b5b57 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:55:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:55:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:55:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:55:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:55:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:55:58 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:55:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:58 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57 1073741824 Jul 17 19:55:58 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:58 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57 1073741824" returned: 0 in 0.528s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:55:58 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57 Jul 17 19:55:58 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:55:58 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Jul 17 19:55:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57" returned: 0 in 0.315s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:55:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:55:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:55:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae3f4909-a87a-47e0-9287-5e73c8657ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb34bcd-27c8-4c8e-a9a4-f3355a8a0ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:55:59 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] Volume volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57 (edb68a5c-d2e6-4866-8771-76e3d28b5b57): created successfully Jul 17 19:55:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb34bcd-27c8-4c8e-a9a4-f3355a8a0ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:55:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] Flow 'volume_create_manager' (7a009238-bcda-493c-ae0f-031f735d980d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:55:59 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-07ea86e8-52e5-46d9-8a2e-3cc6728ca7eb tempest-ProjectMemberTests-1057790160 None] Created volume successfully. Jul 17 19:56:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-94c96c87-44ed-4b6b-845a-2e3c4d971b47 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-94c96c87-44ed-4b6b-845a-2e3c4d971b47 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:00 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-94c96c87-44ed-4b6b-845a-2e3c4d971b47 tempest-ProjectMemberTests-1057790160 None] Creating offline snapshot f2371bc3-dfce-4cbc-a35a-5de7b2b0821c of volume edb68a5c-d2e6-4866-8771-76e3d28b5b57 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:56:00 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:56:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] Flow 'volume_create_manager' (fc80ac8c-caf6-4508-94a6-50dfd8e41dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:56:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fabeafa-0473-45b5-934e-f77d8e1f8926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:00 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a12ccd-2090-44fc-9082-3beb7b0497ec]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-94c96c87-44ed-4b6b-845a-2e3c4d971b47 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fabeafa-0473-45b5-934e-f77d8e1f8926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-129715022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9811ba2-638f-4c33-932e-08854f245eac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71095797784d46b09417263dda7b10b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:56:01Z,use_quota=True,user_id='7118f39efbcc489fad07aff13da7edfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cd02df1-d14f-4db3-a01f-437169a39d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cd02df1-d14f-4db3-a01f-437169a39d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df702dd-e875-4622-9603-3781697be1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df702dd-e875-4622-9603-3781697be1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9811ba2-638f-4c33-932e-08854f245eac', 'volume_name': 'volume-b9811ba2-638f-4c33-932e-08854f245eac', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774aa941-1cd8-4fc9-9ec7-f9432d72608c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774aa941-1cd8-4fc9-9ec7-f9432d72608c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:00 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9f9e08-97f8-4d72-8932-d3dcfaa1ccdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:00 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] Volume b9811ba2-638f-4c33-932e-08854f245eac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9811ba2-638f-4c33-932e-08854f245eac', 'volume_size': 1} Jul 17 19:56:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:00 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57 Jul 17 19:56:00 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:00 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-94c96c87-44ed-4b6b-845a-2e3c4d971b47 tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57" returned: 0 in 0.368s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-94c96c87-44ed-4b6b-845a-2e3c4d971b47 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57.f2371bc3-dfce-4cbc-a35a-5de7b2b0821c 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:01 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57.f2371bc3-dfce-4cbc-a35a-5de7b2b0821c 1G Jul 17 19:56:01 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:01 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-94c96c87-44ed-4b6b-845a-2e3c4d971b47 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57.f2371bc3-dfce-4cbc-a35a-5de7b2b0821c 1G" returned: 0 in 0.428s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-94c96c87-44ed-4b6b-845a-2e3c4d971b47 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57.f2371bc3-dfce-4cbc-a35a-5de7b2b0821c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:01 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57.f2371bc3-dfce-4cbc-a35a-5de7b2b0821c Jul 17 19:56:01 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:01 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-94c96c87-44ed-4b6b-845a-2e3c4d971b47 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57.f2371bc3-dfce-4cbc-a35a-5de7b2b0821c" returned: 0 in 0.319s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:01 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-94c96c87-44ed-4b6b-845a-2e3c4d971b47 tempest-ProjectMemberTests-1057790160 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57.f2371bc3-dfce-4cbc-a35a-5de7b2b0821c is being set with open permissions: ugo+rw Jul 17 19:56:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-94c96c87-44ed-4b6b-845a-2e3c4d971b47 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57.f2371bc3-dfce-4cbc-a35a-5de7b2b0821c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:01 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57.f2371bc3-dfce-4cbc-a35a-5de7b2b0821c Jul 17 19:56:01 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:01 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-94c96c87-44ed-4b6b-845a-2e3c4d971b47 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57.f2371bc3-dfce-4cbc-a35a-5de7b2b0821c" returned: 0 in 0.251s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-94c96c87-44ed-4b6b-845a-2e3c4d971b47 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:02 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57.info Jul 17 19:56:02 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:02 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-94c96c87-44ed-4b6b-845a-2e3c4d971b47 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57.info" returned: 0 in 0.261s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:02 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-94c96c87-44ed-4b6b-845a-2e3c4d971b47 tempest-ProjectMemberTests-1057790160 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57.info is being set with open permissions: ugo+rw Jul 17 19:56:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-94c96c87-44ed-4b6b-845a-2e3c4d971b47 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:02 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57.info Jul 17 19:56:02 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:02 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-94c96c87-44ed-4b6b-845a-2e3c4d971b47 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57.info" returned: 0 in 0.266s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-94c96c87-44ed-4b6b-845a-2e3c4d971b47 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.022s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.889s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:02 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-129715022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9811ba2-638f-4c33-932e-08854f245eac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71095797784d46b09417263dda7b10b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:56:01Z,use_quota=True,user_id='7118f39efbcc489fad07aff13da7edfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:56:02 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] Creating volume b9811ba2-638f-4c33-932e-08854f245eac {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:56:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:02 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:56:02 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:56:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:02 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:56:02 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:56:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:02 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac 1073741824 Jul 17 19:56:02 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:02 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-94c96c87-44ed-4b6b-845a-2e3c4d971b47 tempest-ProjectMemberTests-1057790160 None] Create snapshot completed successfully Jul 17 19:56:03 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac 1073741824" returned: 0 in 0.450s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:03 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac Jul 17 19:56:03 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:03 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac" returned: 0 in 0.255s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:03 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:56:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:03 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9f9e08-97f8-4d72-8932-d3dcfaa1ccdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9811ba2-638f-4c33-932e-08854f245eac', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:03 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aedf8e7-6df0-4843-8280-70c5c9941fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:03 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] Volume volume-b9811ba2-638f-4c33-932e-08854f245eac (b9811ba2-638f-4c33-932e-08854f245eac): created successfully Jul 17 19:56:03 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aedf8e7-6df0-4843-8280-70c5c9941fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:03 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] Flow 'volume_create_manager' (fc80ac8c-caf6-4508-94a6-50dfd8e41dc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:56:03 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e4e58e7b-085e-4f19-bb1b-26de0a7e580d tempest-ProjectReaderTests-1417432126 None] Created volume successfully. Jul 17 19:56:03 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f80d8b1f-b5de-4402-a77c-106184a163d2 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-f2371bc3-dfce-4cbc-a35a-5de7b2b0821c-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:03 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f80d8b1f-b5de-4402-a77c-106184a163d2 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-f2371bc3-dfce-4cbc-a35a-5de7b2b0821c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:03 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f80d8b1f-b5de-4402-a77c-106184a163d2 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-quobyte-edb68a5c-d2e6-4866-8771-76e3d28b5b57" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:03 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f80d8b1f-b5de-4402-a77c-106184a163d2 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-edb68a5c-d2e6-4866-8771-76e3d28b5b57" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:03 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f80d8b1f-b5de-4402-a77c-106184a163d2 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-quobyte-f2371bc3-dfce-4cbc-a35a-5de7b2b0821c" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:03 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f80d8b1f-b5de-4402-a77c-106184a163d2 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-f2371bc3-dfce-4cbc-a35a-5de7b2b0821c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:03 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-f80d8b1f-b5de-4402-a77c-106184a163d2 tempest-ProjectMemberTests-1057790160 None] Deleting offline snapshot f2371bc3-dfce-4cbc-a35a-5de7b2b0821c of volume edb68a5c-d2e6-4866-8771-76e3d28b5b57 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:56:03 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-f80d8b1f-b5de-4402-a77c-106184a163d2 tempest-ProjectMemberTests-1057790160 None] snapshot_file for this snap is: volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57.f2371bc3-dfce-4cbc-a35a-5de7b2b0821c {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:56:03 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58d6a4c-8d71-4d04-a466-fa5d25e1117e]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f80d8b1f-b5de-4402-a77c-106184a163d2 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57.f2371bc3-dfce-4cbc-a35a-5de7b2b0821c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5f5d2599-bd82-4e2c-9b13-802a30072e31 tempest-ProjectReaderTests-1417432126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5f5d2599-bd82-4e2c-9b13-802a30072e31 tempest-ProjectReaderTests-1417432126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:04 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-5f5d2599-bd82-4e2c-9b13-802a30072e31 tempest-ProjectReaderTests-1417432126 None] Creating offline snapshot 2ba48579-2852-4e3b-9d9c-9f6df228c7d6 of volume b9811ba2-638f-4c33-932e-08854f245eac {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:56:04 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[1035f151-6dbf-4406-9dbf-e3c387a15371]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5f5d2599-bd82-4e2c-9b13-802a30072e31 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:04 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57.f2371bc3-dfce-4cbc-a35a-5de7b2b0821c Jul 17 19:56:04 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:04 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac Jul 17 19:56:04 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:04 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f80d8b1f-b5de-4402-a77c-106184a163d2 tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57.f2371bc3-dfce-4cbc-a35a-5de7b2b0821c" returned: 0 in 0.398s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:04 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-f80d8b1f-b5de-4402-a77c-106184a163d2 tempest-ProjectMemberTests-1057790160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:56:04 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f96e503-495a-43a0-9189-3e0cb4fc3e24]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f80d8b1f-b5de-4402-a77c-106184a163d2 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:04 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5f5d2599-bd82-4e2c-9b13-802a30072e31 tempest-ProjectReaderTests-1417432126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac" returned: 0 in 0.432s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5f5d2599-bd82-4e2c-9b13-802a30072e31 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac.2ba48579-2852-4e3b-9d9c-9f6df228c7d6 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:04 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57 Jul 17 19:56:04 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:04 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac.2ba48579-2852-4e3b-9d9c-9f6df228c7d6 1G Jul 17 19:56:04 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:04 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f80d8b1f-b5de-4402-a77c-106184a163d2 tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57" returned: 0 in 0.415s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f80d8b1f-b5de-4402-a77c-106184a163d2 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57.f2371bc3-dfce-4cbc-a35a-5de7b2b0821c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:04 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57.f2371bc3-dfce-4cbc-a35a-5de7b2b0821c Jul 17 19:56:04 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:04 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5f5d2599-bd82-4e2c-9b13-802a30072e31 tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac.2ba48579-2852-4e3b-9d9c-9f6df228c7d6 1G" returned: 0 in 0.465s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5f5d2599-bd82-4e2c-9b13-802a30072e31 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9811ba2-638f-4c33-932e-08854f245eac -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac.2ba48579-2852-4e3b-9d9c-9f6df228c7d6 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:04 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9811ba2-638f-4c33-932e-08854f245eac -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac.2ba48579-2852-4e3b-9d9c-9f6df228c7d6 Jul 17 19:56:04 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:05 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f80d8b1f-b5de-4402-a77c-106184a163d2 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57.f2371bc3-dfce-4cbc-a35a-5de7b2b0821c" returned: 0 in 0.339s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f80d8b1f-b5de-4402-a77c-106184a163d2 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57.f2371bc3-dfce-4cbc-a35a-5de7b2b0821c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:05 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57.f2371bc3-dfce-4cbc-a35a-5de7b2b0821c Jul 17 19:56:05 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:05 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5f5d2599-bd82-4e2c-9b13-802a30072e31 tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9811ba2-638f-4c33-932e-08854f245eac -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac.2ba48579-2852-4e3b-9d9c-9f6df228c7d6" returned: 0 in 0.289s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:05 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-5f5d2599-bd82-4e2c-9b13-802a30072e31 tempest-ProjectReaderTests-1417432126 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac.2ba48579-2852-4e3b-9d9c-9f6df228c7d6 is being set with open permissions: ugo+rw Jul 17 19:56:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5f5d2599-bd82-4e2c-9b13-802a30072e31 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac.2ba48579-2852-4e3b-9d9c-9f6df228c7d6 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:05 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac.2ba48579-2852-4e3b-9d9c-9f6df228c7d6 Jul 17 19:56:05 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:05 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f80d8b1f-b5de-4402-a77c-106184a163d2 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57.f2371bc3-dfce-4cbc-a35a-5de7b2b0821c" returned: 0 in 0.255s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f80d8b1f-b5de-4402-a77c-106184a163d2 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-f2371bc3-dfce-4cbc-a35a-5de7b2b0821c" released by "_delete_snapshot" :: held 1.541s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f80d8b1f-b5de-4402-a77c-106184a163d2 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-edb68a5c-d2e6-4866-8771-76e3d28b5b57" released by "delete_snapshot" :: held 1.566s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:05 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-f80d8b1f-b5de-4402-a77c-106184a163d2 tempest-ProjectMemberTests-1057790160 None] Created reservations ['3f71556e-9826-4d30-9f7b-4262d89e6f68', '2ef72749-8f5c-4e57-bf6a-5abcd11f1bb8', '53316898-1076-4421-bd37-bf3648acbba9', 'a239517d-dbd3-499e-bebe-c200878535e5'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:56:05 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5f5d2599-bd82-4e2c-9b13-802a30072e31 tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac.2ba48579-2852-4e3b-9d9c-9f6df228c7d6" returned: 0 in 0.261s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5f5d2599-bd82-4e2c-9b13-802a30072e31 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:05 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac.info Jul 17 19:56:05 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:05 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-f80d8b1f-b5de-4402-a77c-106184a163d2 tempest-ProjectMemberTests-1057790160 None] Delete snapshot completed successfully. Jul 17 19:56:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f80d8b1f-b5de-4402-a77c-106184a163d2 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-f2371bc3-dfce-4cbc-a35a-5de7b2b0821c-delete_snapshot" released by "delete_snapshot" :: held 1.736s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:05 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5f5d2599-bd82-4e2c-9b13-802a30072e31 tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac.info" returned: 0 in 0.242s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:05 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-5f5d2599-bd82-4e2c-9b13-802a30072e31 tempest-ProjectReaderTests-1417432126 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac.info is being set with open permissions: ugo+rw Jul 17 19:56:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5f5d2599-bd82-4e2c-9b13-802a30072e31 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:05 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac.info Jul 17 19:56:05 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7a53333c-db33-46dc-849f-df6d8c642e25 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-edb68a5c-d2e6-4866-8771-76e3d28b5b57-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:05 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5f5d2599-bd82-4e2c-9b13-802a30072e31 tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac.info" returned: 0 in 0.237s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5f5d2599-bd82-4e2c-9b13-802a30072e31 tempest-ProjectReaderTests-1417432126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.014s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:06 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7a53333c-db33-46dc-849f-df6d8c642e25 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-edb68a5c-d2e6-4866-8771-76e3d28b5b57-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:06 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-5f5d2599-bd82-4e2c-9b13-802a30072e31 tempest-ProjectReaderTests-1417432126 None] Create snapshot completed successfully Jul 17 19:56:06 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7a53333c-db33-46dc-849f-df6d8c642e25 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-quobyte-edb68a5c-d2e6-4866-8771-76e3d28b5b57" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:06 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7a53333c-db33-46dc-849f-df6d8c642e25 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-edb68a5c-d2e6-4866-8771-76e3d28b5b57" acquired by "delete_volume" :: waited 0.015s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:06 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4b7fa7-f3b2-48c7-9aaa-d6d4f2c273f6]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7a53333c-db33-46dc-849f-df6d8c642e25 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:06 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57 Jul 17 19:56:06 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:06 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7a53333c-db33-46dc-849f-df6d8c642e25 tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57" returned: 0 in 0.342s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7a53333c-db33-46dc-849f-df6d8c642e25 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:06 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57 Jul 17 19:56:06 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:06 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7a53333c-db33-46dc-849f-df6d8c642e25 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-edb68a5c-d2e6-4866-8771-76e3d28b5b57" returned: 0 in 0.241s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:06 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7a53333c-db33-46dc-849f-df6d8c642e25 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-edb68a5c-d2e6-4866-8771-76e3d28b5b57" released by "delete_volume" :: held 0.632s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:06 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-7a53333c-db33-46dc-849f-df6d8c642e25 tempest-ProjectMemberTests-1057790160 None] Created reservations ['602394d8-3d85-487d-9c50-801cd6a18b99', '9c85f60b-78df-4668-ab7c-09732c23cc6d', 'd7c1e3a1-3d11-4b99-b7d8-20d518aae30c', '3610921d-d5a8-4f43-944f-c29a287754ef'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:56:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7a53333c-db33-46dc-849f-df6d8c642e25 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7a53333c-db33-46dc-849f-df6d8c642e25 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:06 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7a53333c-db33-46dc-849f-df6d8c642e25 tempest-ProjectMemberTests-1057790160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:56:06 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7a53333c-db33-46dc-849f-df6d8c642e25 tempest-ProjectMemberTests-1057790160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:56:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7a53333c-db33-46dc-849f-df6d8c642e25 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:06 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7a53333c-db33-46dc-849f-df6d8c642e25 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:06 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:56:06 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:07 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7a53333c-db33-46dc-849f-df6d8c642e25 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.258s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-7a53333c-db33-46dc-849f-df6d8c642e25 tempest-ProjectMemberTests-1057790160 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:56:07 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-7a53333c-db33-46dc-849f-df6d8c642e25 tempest-ProjectMemberTests-1057790160 None] Deleted volume successfully. Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7a53333c-db33-46dc-849f-df6d8c642e25 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-edb68a5c-d2e6-4866-8771-76e3d28b5b57-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-34f5aee7-28a9-47d6-bf0d-b4244e174f32 tempest-ProjectReaderTests-1417432126 None] Acquiring lock "cinder-2ba48579-2852-4e3b-9d9c-9f6df228c7d6-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-34f5aee7-28a9-47d6-bf0d-b4244e174f32 tempest-ProjectReaderTests-1417432126 None] Lock "cinder-2ba48579-2852-4e3b-9d9c-9f6df228c7d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-34f5aee7-28a9-47d6-bf0d-b4244e174f32 tempest-ProjectReaderTests-1417432126 None] Acquiring lock "cinder-quobyte-b9811ba2-638f-4c33-932e-08854f245eac" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-34f5aee7-28a9-47d6-bf0d-b4244e174f32 tempest-ProjectReaderTests-1417432126 None] Lock "cinder-quobyte-b9811ba2-638f-4c33-932e-08854f245eac" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-34f5aee7-28a9-47d6-bf0d-b4244e174f32 tempest-ProjectReaderTests-1417432126 None] Acquiring lock "cinder-quobyte-2ba48579-2852-4e3b-9d9c-9f6df228c7d6" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-34f5aee7-28a9-47d6-bf0d-b4244e174f32 tempest-ProjectReaderTests-1417432126 None] Lock "cinder-quobyte-2ba48579-2852-4e3b-9d9c-9f6df228c7d6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-34f5aee7-28a9-47d6-bf0d-b4244e174f32 tempest-ProjectReaderTests-1417432126 None] Deleting offline snapshot 2ba48579-2852-4e3b-9d9c-9f6df228c7d6 of volume b9811ba2-638f-4c33-932e-08854f245eac {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-34f5aee7-28a9-47d6-bf0d-b4244e174f32 tempest-ProjectReaderTests-1417432126 None] snapshot_file for this snap is: volume-b9811ba2-638f-4c33-932e-08854f245eac.2ba48579-2852-4e3b-9d9c-9f6df228c7d6 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff5b609-942f-4ca7-a375-81537f007476]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-34f5aee7-28a9-47d6-bf0d-b4244e174f32 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac.2ba48579-2852-4e3b-9d9c-9f6df228c7d6 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] Flow 'volume_create_manager' (fb183eb9-c6aa-4bdb-b586-88e04f3db8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dfbe610-0971-4fcf-946a-a269963bff64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dfbe610-0971-4fcf-946a-a269963bff64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-633558391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6608f8c-5801-4d0d-9762-75c0d0f103f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='292c7664e8d0464b8d760da18a48ef96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:56:08Z,use_quota=True,user_id='2116daf9106f417f838ea1e496129378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:07 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac.2ba48579-2852-4e3b-9d9c-9f6df228c7d6 Jul 17 19:56:07 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8087100-181a-4abf-bced-83433220c6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8087100-181a-4abf-bced-83433220c6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b5d43fe-280a-4445-8346-11b751880994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b5d43fe-280a-4445-8346-11b751880994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6608f8c-5801-4d0d-9762-75c0d0f103f4', 'volume_name': 'volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (906f8a03-19dc-4ab5-8928-3f9be6751572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (906f8a03-19dc-4ab5-8928-3f9be6751572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0257cf6-ac9b-44ca-8696-3ce3b47e2bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:07 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] Volume c6608f8c-5801-4d0d-9762-75c0d0f103f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4', 'volume_size': 1} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-633558391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6608f8c-5801-4d0d-9762-75c0d0f103f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='292c7664e8d0464b8d760da18a48ef96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:56:08Z,use_quota=True,user_id='2116daf9106f417f838ea1e496129378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] Creating volume c6608f8c-5801-4d0d-9762-75c0d0f103f4 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:56:07 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:07 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4 1073741824 Jul 17 19:56:07 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:07 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-34f5aee7-28a9-47d6-bf0d-b4244e174f32 tempest-ProjectReaderTests-1417432126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac.2ba48579-2852-4e3b-9d9c-9f6df228c7d6" returned: 0 in 0.359s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-34f5aee7-28a9-47d6-bf0d-b4244e174f32 tempest-ProjectReaderTests-1417432126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9811ba2-638f-4c33-932e-08854f245eac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ebe6be-9ba3-4944-8e8b-25ecb3a782c0]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:07 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-34f5aee7-28a9-47d6-bf0d-b4244e174f32 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:08 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac Jul 17 19:56:08 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:08 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4 1073741824" returned: 0 in 0.445s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:08 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4 Jul 17 19:56:08 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:08 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-34f5aee7-28a9-47d6-bf0d-b4244e174f32 tempest-ProjectReaderTests-1417432126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac" returned: 0 in 0.380s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-34f5aee7-28a9-47d6-bf0d-b4244e174f32 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac.2ba48579-2852-4e3b-9d9c-9f6df228c7d6 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:08 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac.2ba48579-2852-4e3b-9d9c-9f6df228c7d6 Jul 17 19:56:08 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:08 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4" returned: 0 in 0.262s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:56:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0257cf6-ac9b-44ca-8696-3ce3b47e2bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e406a2a4-181a-4d02-b31b-48b4853f8a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:08 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] Volume volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4 (c6608f8c-5801-4d0d-9762-75c0d0f103f4): created successfully Jul 17 19:56:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e406a2a4-181a-4d02-b31b-48b4853f8a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:08 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] Flow 'volume_create_manager' (fb183eb9-c6aa-4bdb-b586-88e04f3db8f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:56:08 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-45d358d7-a2b9-4ace-9862-59bf117d29a8 tempest-ProjectMemberTests-1057790160 None] Created volume successfully. Jul 17 19:56:08 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-34f5aee7-28a9-47d6-bf0d-b4244e174f32 tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac.2ba48579-2852-4e3b-9d9c-9f6df228c7d6" returned: 0 in 0.374s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-34f5aee7-28a9-47d6-bf0d-b4244e174f32 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac.2ba48579-2852-4e3b-9d9c-9f6df228c7d6 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:08 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac.2ba48579-2852-4e3b-9d9c-9f6df228c7d6 Jul 17 19:56:08 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7fe10435-b278-4d47-b62c-75a19fa15bd7 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7fe10435-b278-4d47-b62c-75a19fa15bd7 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:08 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-7fe10435-b278-4d47-b62c-75a19fa15bd7 tempest-ProjectMemberTests-1057790160 None] Creating offline snapshot 6cd34756-8d8a-429d-8ea3-7c2218cfede1 of volume c6608f8c-5801-4d0d-9762-75c0d0f103f4 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:56:08 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f55b236-69b3-44ea-98f5-02921ddb1fc2]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7fe10435-b278-4d47-b62c-75a19fa15bd7 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:08 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:08 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-34f5aee7-28a9-47d6-bf0d-b4244e174f32 tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac.2ba48579-2852-4e3b-9d9c-9f6df228c7d6" returned: 0 in 0.259s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:08 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4 Jul 17 19:56:08 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:08 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-34f5aee7-28a9-47d6-bf0d-b4244e174f32 tempest-ProjectReaderTests-1417432126 None] Lock "cinder-quobyte-2ba48579-2852-4e3b-9d9c-9f6df228c7d6" released by "_delete_snapshot" :: held 1.471s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:08 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-34f5aee7-28a9-47d6-bf0d-b4244e174f32 tempest-ProjectReaderTests-1417432126 None] Lock "cinder-quobyte-b9811ba2-638f-4c33-932e-08854f245eac" released by "delete_snapshot" :: held 1.495s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:09 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-34f5aee7-28a9-47d6-bf0d-b4244e174f32 tempest-ProjectReaderTests-1417432126 None] Created reservations ['9e1a9a64-d968-4424-a193-8cbef8804005', '356da8dc-3200-460b-b60c-9802d32a5ffc', 'cf5014f7-403f-4fa5-aa27-cd4a7d387963', '5b069296-e173-42a9-93a7-abb8a61ba513'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:56:09 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-34f5aee7-28a9-47d6-bf0d-b4244e174f32 tempest-ProjectReaderTests-1417432126 None] Delete snapshot completed successfully. Jul 17 19:56:09 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-34f5aee7-28a9-47d6-bf0d-b4244e174f32 tempest-ProjectReaderTests-1417432126 None] Lock "cinder-2ba48579-2852-4e3b-9d9c-9f6df228c7d6-delete_snapshot" released by "delete_snapshot" :: held 1.632s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:09 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7fe10435-b278-4d47-b62c-75a19fa15bd7 tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4" returned: 0 in 0.356s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7fe10435-b278-4d47-b62c-75a19fa15bd7 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4.6cd34756-8d8a-429d-8ea3-7c2218cfede1 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:09 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4.6cd34756-8d8a-429d-8ea3-7c2218cfede1 1G Jul 17 19:56:09 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:09 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7fe10435-b278-4d47-b62c-75a19fa15bd7 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4.6cd34756-8d8a-429d-8ea3-7c2218cfede1 1G" returned: 0 in 0.413s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7fe10435-b278-4d47-b62c-75a19fa15bd7 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4.6cd34756-8d8a-429d-8ea3-7c2218cfede1 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:09 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ebd8d779-602b-4261-8845-66e2494507b2 tempest-ProjectReaderTests-1417432126 None] Acquiring lock "cinder-b9811ba2-638f-4c33-932e-08854f245eac-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:09 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4.6cd34756-8d8a-429d-8ea3-7c2218cfede1 Jul 17 19:56:09 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:09 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ebd8d779-602b-4261-8845-66e2494507b2 tempest-ProjectReaderTests-1417432126 None] Lock "cinder-b9811ba2-638f-4c33-932e-08854f245eac-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:09 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ebd8d779-602b-4261-8845-66e2494507b2 tempest-ProjectReaderTests-1417432126 None] Acquiring lock "cinder-quobyte-b9811ba2-638f-4c33-932e-08854f245eac" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:09 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ebd8d779-602b-4261-8845-66e2494507b2 tempest-ProjectReaderTests-1417432126 None] Lock "cinder-quobyte-b9811ba2-638f-4c33-932e-08854f245eac" acquired by "delete_volume" :: waited 0.014s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:09 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a319088-2708-4e1e-9344-e1011528ad0e]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ebd8d779-602b-4261-8845-66e2494507b2 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:09 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac Jul 17 19:56:09 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:09 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7fe10435-b278-4d47-b62c-75a19fa15bd7 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4.6cd34756-8d8a-429d-8ea3-7c2218cfede1" returned: 0 in 0.347s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:09 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-7fe10435-b278-4d47-b62c-75a19fa15bd7 tempest-ProjectMemberTests-1057790160 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4.6cd34756-8d8a-429d-8ea3-7c2218cfede1 is being set with open permissions: ugo+rw Jul 17 19:56:09 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7fe10435-b278-4d47-b62c-75a19fa15bd7 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4.6cd34756-8d8a-429d-8ea3-7c2218cfede1 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:09 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4.6cd34756-8d8a-429d-8ea3-7c2218cfede1 Jul 17 19:56:09 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:10 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ebd8d779-602b-4261-8845-66e2494507b2 tempest-ProjectReaderTests-1417432126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac" returned: 0 in 0.396s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ebd8d779-602b-4261-8845-66e2494507b2 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:10 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac Jul 17 19:56:10 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:10 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7fe10435-b278-4d47-b62c-75a19fa15bd7 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4.6cd34756-8d8a-429d-8ea3-7c2218cfede1" returned: 0 in 0.257s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7fe10435-b278-4d47-b62c-75a19fa15bd7 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:10 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4.info Jul 17 19:56:10 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:10 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ebd8d779-602b-4261-8845-66e2494507b2 tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b9811ba2-638f-4c33-932e-08854f245eac" returned: 0 in 0.252s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ebd8d779-602b-4261-8845-66e2494507b2 tempest-ProjectReaderTests-1417432126 None] Lock "cinder-quobyte-b9811ba2-638f-4c33-932e-08854f245eac" released by "delete_volume" :: held 0.711s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:10 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-ebd8d779-602b-4261-8845-66e2494507b2 tempest-ProjectReaderTests-1417432126 None] Created reservations ['8ab459b8-5642-49be-861a-320fd1d73524', '5315678d-b4de-4de6-8e17-5aec783089c6', '26a04c39-4ea6-43c2-a500-817fb988b611', 'a28c59eb-f372-4ceb-be4f-2268bf736c4f'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:56:10 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7fe10435-b278-4d47-b62c-75a19fa15bd7 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4.info" returned: 0 in 0.254s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:10 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-7fe10435-b278-4d47-b62c-75a19fa15bd7 tempest-ProjectMemberTests-1057790160 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4.info is being set with open permissions: ugo+rw Jul 17 19:56:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7fe10435-b278-4d47-b62c-75a19fa15bd7 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:10 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4.info Jul 17 19:56:10 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ebd8d779-602b-4261-8845-66e2494507b2 tempest-ProjectReaderTests-1417432126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ebd8d779-602b-4261-8845-66e2494507b2 tempest-ProjectReaderTests-1417432126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ebd8d779-602b-4261-8845-66e2494507b2 tempest-ProjectReaderTests-1417432126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:56:10 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ebd8d779-602b-4261-8845-66e2494507b2 tempest-ProjectReaderTests-1417432126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:56:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ebd8d779-602b-4261-8845-66e2494507b2 tempest-ProjectReaderTests-1417432126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ebd8d779-602b-4261-8845-66e2494507b2 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:10 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:56:10 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:10 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7fe10435-b278-4d47-b62c-75a19fa15bd7 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4.info" returned: 0 in 0.273s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7fe10435-b278-4d47-b62c-75a19fa15bd7 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.985s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:10 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-7fe10435-b278-4d47-b62c-75a19fa15bd7 tempest-ProjectMemberTests-1057790160 None] Create snapshot completed successfully Jul 17 19:56:10 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:10 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ebd8d779-602b-4261-8845-66e2494507b2 tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.271s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:10 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-ebd8d779-602b-4261-8845-66e2494507b2 tempest-ProjectReaderTests-1417432126 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:56:10 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-ebd8d779-602b-4261-8845-66e2494507b2 tempest-ProjectReaderTests-1417432126 None] Deleted volume successfully. Jul 17 19:56:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-ebd8d779-602b-4261-8845-66e2494507b2 tempest-ProjectReaderTests-1417432126 None] Lock "cinder-b9811ba2-638f-4c33-932e-08854f245eac-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-dec23521-ff9c-4c1e-8499-f05d59e1c2ae tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-6cd34756-8d8a-429d-8ea3-7c2218cfede1-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-dec23521-ff9c-4c1e-8499-f05d59e1c2ae tempest-ProjectMemberTests-1057790160 None] Lock "cinder-6cd34756-8d8a-429d-8ea3-7c2218cfede1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-dec23521-ff9c-4c1e-8499-f05d59e1c2ae tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-quobyte-c6608f8c-5801-4d0d-9762-75c0d0f103f4" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-dec23521-ff9c-4c1e-8499-f05d59e1c2ae tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-c6608f8c-5801-4d0d-9762-75c0d0f103f4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:10 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-dec23521-ff9c-4c1e-8499-f05d59e1c2ae tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-quobyte-6cd34756-8d8a-429d-8ea3-7c2218cfede1" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-dec23521-ff9c-4c1e-8499-f05d59e1c2ae tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-6cd34756-8d8a-429d-8ea3-7c2218cfede1" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-dec23521-ff9c-4c1e-8499-f05d59e1c2ae tempest-ProjectMemberTests-1057790160 None] Deleting offline snapshot 6cd34756-8d8a-429d-8ea3-7c2218cfede1 of volume c6608f8c-5801-4d0d-9762-75c0d0f103f4 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-dec23521-ff9c-4c1e-8499-f05d59e1c2ae tempest-ProjectMemberTests-1057790160 None] snapshot_file for this snap is: volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4.6cd34756-8d8a-429d-8ea3-7c2218cfede1 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[1679cad4-13c2-4896-903b-9bf75a6d3994]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dec23521-ff9c-4c1e-8499-f05d59e1c2ae tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4.6cd34756-8d8a-429d-8ea3-7c2218cfede1 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:11 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4.6cd34756-8d8a-429d-8ea3-7c2218cfede1 Jul 17 19:56:11 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] Flow 'volume_create_manager' (f729992b-7d90-4cb2-8017-b2f6b5dd5183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aac8fd4-e668-43dc-ba43-8bce622e80aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aac8fd4-e668-43dc-ba43-8bce622e80aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1089816563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd5027af-e8e4-41f1-8e57-0cb92f2c2b83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71095797784d46b09417263dda7b10b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:56:11Z,use_quota=True,user_id='7118f39efbcc489fad07aff13da7edfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09e18efb-c758-4a68-89fd-56538b5307ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09e18efb-c758-4a68-89fd-56538b5307ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f7c6a2c-28c0-4f45-9fc3-e01cf41e7935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f7c6a2c-28c0-4f45-9fc3-e01cf41e7935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd5027af-e8e4-41f1-8e57-0cb92f2c2b83', 'volume_name': 'volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6acd7638-3975-4946-898e-014749efc273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6acd7638-3975-4946-898e-014749efc273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e2bfe53-3004-4be4-bc89-06d47474aed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:11 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] Volume cd5027af-e8e4-41f1-8e57-0cb92f2c2b83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83', 'volume_size': 1} Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1089816563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd5027af-e8e4-41f1-8e57-0cb92f2c2b83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71095797784d46b09417263dda7b10b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:56:11Z,use_quota=True,user_id='7118f39efbcc489fad07aff13da7edfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] Creating volume cd5027af-e8e4-41f1-8e57-0cb92f2c2b83 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:56:11 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:11 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83 1073741824 Jul 17 19:56:11 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:11 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dec23521-ff9c-4c1e-8499-f05d59e1c2ae tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4.6cd34756-8d8a-429d-8ea3-7c2218cfede1" returned: 0 in 0.401s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-dec23521-ff9c-4c1e-8499-f05d59e1c2ae tempest-ProjectMemberTests-1057790160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[382144d8-98a1-449b-8889-ffad12458182]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dec23521-ff9c-4c1e-8499-f05d59e1c2ae tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:11 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4 Jul 17 19:56:11 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:11 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83 1073741824" returned: 0 in 0.436s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:11 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dec23521-ff9c-4c1e-8499-f05d59e1c2ae tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4" returned: 0 in 0.391s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:11 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dec23521-ff9c-4c1e-8499-f05d59e1c2ae tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4.6cd34756-8d8a-429d-8ea3-7c2218cfede1 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:11 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83 Jul 17 19:56:11 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:11 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4.6cd34756-8d8a-429d-8ea3-7c2218cfede1 Jul 17 19:56:11 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:12 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83" returned: 0 in 0.258s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:56:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e2bfe53-3004-4be4-bc89-06d47474aed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8448ba59-df4f-4b61-9a0d-508ea1e5d832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:12 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] Volume volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83 (cd5027af-e8e4-41f1-8e57-0cb92f2c2b83): created successfully Jul 17 19:56:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8448ba59-df4f-4b61-9a0d-508ea1e5d832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:12 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] Flow 'volume_create_manager' (f729992b-7d90-4cb2-8017-b2f6b5dd5183) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:56:12 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-cf6adda8-d444-4acc-8757-c159a9a15aef tempest-ProjectReaderTests-1417432126 None] Created volume successfully. Jul 17 19:56:12 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dec23521-ff9c-4c1e-8499-f05d59e1c2ae tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4.6cd34756-8d8a-429d-8ea3-7c2218cfede1" returned: 0 in 0.349s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dec23521-ff9c-4c1e-8499-f05d59e1c2ae tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4.6cd34756-8d8a-429d-8ea3-7c2218cfede1 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:12 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4.6cd34756-8d8a-429d-8ea3-7c2218cfede1 Jul 17 19:56:12 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f4c26ee0-c19e-4f26-9b29-77ee065f672f tempest-ProjectReaderTests-1417432126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f4c26ee0-c19e-4f26-9b29-77ee065f672f tempest-ProjectReaderTests-1417432126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:12 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:12 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-f4c26ee0-c19e-4f26-9b29-77ee065f672f tempest-ProjectReaderTests-1417432126 None] Creating offline snapshot a6bee88d-805e-4640-b98f-dabe8d38046e of volume cd5027af-e8e4-41f1-8e57-0cb92f2c2b83 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:56:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-dec23521-ff9c-4c1e-8499-f05d59e1c2ae tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4.6cd34756-8d8a-429d-8ea3-7c2218cfede1" returned: 0 in 0.273s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:12 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c163e2-eb32-4682-91cb-f1671d4e5882]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f4c26ee0-c19e-4f26-9b29-77ee065f672f tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:12 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-dec23521-ff9c-4c1e-8499-f05d59e1c2ae tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-6cd34756-8d8a-429d-8ea3-7c2218cfede1" released by "_delete_snapshot" :: held 1.533s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:12 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-dec23521-ff9c-4c1e-8499-f05d59e1c2ae tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-c6608f8c-5801-4d0d-9762-75c0d0f103f4" released by "delete_snapshot" :: held 1.556s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:12 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-dec23521-ff9c-4c1e-8499-f05d59e1c2ae tempest-ProjectMemberTests-1057790160 None] Created reservations ['f031ec25-6bcf-4990-ae5a-f4ddc522f065', '6126ac51-4084-4c9d-8201-c1a4b809e5a9', 'c7d7271a-3d14-4c2c-bed9-ab0ac9a02fe9', '97bb5f78-2f2e-45bf-bfcd-4524b25e4dd3'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:56:12 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83 Jul 17 19:56:12 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:12 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-dec23521-ff9c-4c1e-8499-f05d59e1c2ae tempest-ProjectMemberTests-1057790160 None] Delete snapshot completed successfully. Jul 17 19:56:12 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-dec23521-ff9c-4c1e-8499-f05d59e1c2ae tempest-ProjectMemberTests-1057790160 None] Lock "cinder-6cd34756-8d8a-429d-8ea3-7c2218cfede1-delete_snapshot" released by "delete_snapshot" :: held 1.714s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:12 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f4c26ee0-c19e-4f26-9b29-77ee065f672f tempest-ProjectReaderTests-1417432126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83" returned: 0 in 0.373s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:12 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f4c26ee0-c19e-4f26-9b29-77ee065f672f tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83.a6bee88d-805e-4640-b98f-dabe8d38046e 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:12 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83.a6bee88d-805e-4640-b98f-dabe8d38046e 1G Jul 17 19:56:12 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7ea2732c-fcd7-4c2b-85bd-76015b4695af tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-c6608f8c-5801-4d0d-9762-75c0d0f103f4-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7ea2732c-fcd7-4c2b-85bd-76015b4695af tempest-ProjectMemberTests-1057790160 None] Lock "cinder-c6608f8c-5801-4d0d-9762-75c0d0f103f4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7ea2732c-fcd7-4c2b-85bd-76015b4695af tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-quobyte-c6608f8c-5801-4d0d-9762-75c0d0f103f4" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7ea2732c-fcd7-4c2b-85bd-76015b4695af tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-c6608f8c-5801-4d0d-9762-75c0d0f103f4" acquired by "delete_volume" :: waited 0.016s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:13 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4e6617-9ef0-49e7-8671-74a1a7edb34e]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7ea2732c-fcd7-4c2b-85bd-76015b4695af tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:13 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f4c26ee0-c19e-4f26-9b29-77ee065f672f tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83.a6bee88d-805e-4640-b98f-dabe8d38046e 1G" returned: 0 in 0.418s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f4c26ee0-c19e-4f26-9b29-77ee065f672f tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83.a6bee88d-805e-4640-b98f-dabe8d38046e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:13 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83.a6bee88d-805e-4640-b98f-dabe8d38046e Jul 17 19:56:13 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:13 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4 Jul 17 19:56:13 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:13 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f4c26ee0-c19e-4f26-9b29-77ee065f672f tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83.a6bee88d-805e-4640-b98f-dabe8d38046e" returned: 0 in 0.297s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:13 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-f4c26ee0-c19e-4f26-9b29-77ee065f672f tempest-ProjectReaderTests-1417432126 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83.a6bee88d-805e-4640-b98f-dabe8d38046e is being set with open permissions: ugo+rw Jul 17 19:56:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f4c26ee0-c19e-4f26-9b29-77ee065f672f tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83.a6bee88d-805e-4640-b98f-dabe8d38046e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:13 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83.a6bee88d-805e-4640-b98f-dabe8d38046e Jul 17 19:56:13 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:13 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7ea2732c-fcd7-4c2b-85bd-76015b4695af tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4" returned: 0 in 0.379s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7ea2732c-fcd7-4c2b-85bd-76015b4695af tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:13 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4 Jul 17 19:56:13 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:13 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f4c26ee0-c19e-4f26-9b29-77ee065f672f tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83.a6bee88d-805e-4640-b98f-dabe8d38046e" returned: 0 in 0.249s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f4c26ee0-c19e-4f26-9b29-77ee065f672f tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:13 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:13 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7ea2732c-fcd7-4c2b-85bd-76015b4695af tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c6608f8c-5801-4d0d-9762-75c0d0f103f4" returned: 0 in 0.256s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:13 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83.info Jul 17 19:56:13 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:13 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7ea2732c-fcd7-4c2b-85bd-76015b4695af tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-c6608f8c-5801-4d0d-9762-75c0d0f103f4" released by "delete_volume" :: held 0.695s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:13 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-7ea2732c-fcd7-4c2b-85bd-76015b4695af tempest-ProjectMemberTests-1057790160 None] Created reservations ['cbcfe8c9-8e43-40ee-bf9a-1a483e2973b4', '32f444c2-809f-4f76-891b-fc827ea4184b', 'f119b625-18ad-4e22-9536-9749188f3d09', '098b2237-361e-480c-aba5-93fb51e6550f'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7ea2732c-fcd7-4c2b-85bd-76015b4695af tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7ea2732c-fcd7-4c2b-85bd-76015b4695af tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7ea2732c-fcd7-4c2b-85bd-76015b4695af tempest-ProjectMemberTests-1057790160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-7ea2732c-fcd7-4c2b-85bd-76015b4695af tempest-ProjectMemberTests-1057790160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-7ea2732c-fcd7-4c2b-85bd-76015b4695af tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7ea2732c-fcd7-4c2b-85bd-76015b4695af tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:14 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:56:14 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:14 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f4c26ee0-c19e-4f26-9b29-77ee065f672f tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83.info" returned: 0 in 0.246s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:14 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-f4c26ee0-c19e-4f26-9b29-77ee065f672f tempest-ProjectReaderTests-1417432126 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83.info is being set with open permissions: ugo+rw Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f4c26ee0-c19e-4f26-9b29-77ee065f672f tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:14 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83.info Jul 17 19:56:14 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:14 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7ea2732c-fcd7-4c2b-85bd-76015b4695af tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.266s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-7ea2732c-fcd7-4c2b-85bd-76015b4695af tempest-ProjectMemberTests-1057790160 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:56:14 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-7ea2732c-fcd7-4c2b-85bd-76015b4695af tempest-ProjectMemberTests-1057790160 None] Deleted volume successfully. Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7ea2732c-fcd7-4c2b-85bd-76015b4695af tempest-ProjectMemberTests-1057790160 None] Lock "cinder-c6608f8c-5801-4d0d-9762-75c0d0f103f4-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:14 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f4c26ee0-c19e-4f26-9b29-77ee065f672f tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83.info" returned: 0 in 0.287s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f4c26ee0-c19e-4f26-9b29-77ee065f672f tempest-ProjectReaderTests-1417432126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.975s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:14 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-f4c26ee0-c19e-4f26-9b29-77ee065f672f tempest-ProjectReaderTests-1417432126 None] Create snapshot completed successfully Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0b260db3-64aa-42c6-918b-3bc659f0741f tempest-ProjectReaderTests-1417432126 None] Acquiring lock "cinder-a6bee88d-805e-4640-b98f-dabe8d38046e-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0b260db3-64aa-42c6-918b-3bc659f0741f tempest-ProjectReaderTests-1417432126 None] Lock "cinder-a6bee88d-805e-4640-b98f-dabe8d38046e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0b260db3-64aa-42c6-918b-3bc659f0741f tempest-ProjectReaderTests-1417432126 None] Acquiring lock "cinder-quobyte-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0b260db3-64aa-42c6-918b-3bc659f0741f tempest-ProjectReaderTests-1417432126 None] Lock "cinder-quobyte-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0b260db3-64aa-42c6-918b-3bc659f0741f tempest-ProjectReaderTests-1417432126 None] Acquiring lock "cinder-quobyte-a6bee88d-805e-4640-b98f-dabe8d38046e" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0b260db3-64aa-42c6-918b-3bc659f0741f tempest-ProjectReaderTests-1417432126 None] Lock "cinder-quobyte-a6bee88d-805e-4640-b98f-dabe8d38046e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-0b260db3-64aa-42c6-918b-3bc659f0741f tempest-ProjectReaderTests-1417432126 None] Deleting offline snapshot a6bee88d-805e-4640-b98f-dabe8d38046e of volume cd5027af-e8e4-41f1-8e57-0cb92f2c2b83 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-0b260db3-64aa-42c6-918b-3bc659f0741f tempest-ProjectReaderTests-1417432126 None] snapshot_file for this snap is: volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83.a6bee88d-805e-4640-b98f-dabe8d38046e {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84e2308-ae39-412b-9a9d-0843ff824d15]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0b260db3-64aa-42c6-918b-3bc659f0741f tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83.a6bee88d-805e-4640-b98f-dabe8d38046e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] Flow 'volume_create_manager' (3fbe3a94-348b-453a-8de9-01b61d879ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16698e2a-0757-426f-ad4b-fad63bb55152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16698e2a-0757-426f-ad4b-fad63bb55152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-275872108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d93276a-fd51-45ce-a065-87b5863df2f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='292c7664e8d0464b8d760da18a48ef96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:56:15Z,use_quota=True,user_id='2116daf9106f417f838ea1e496129378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:14 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83.a6bee88d-805e-4640-b98f-dabe8d38046e Jul 17 19:56:14 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d8a6d22-5137-494f-9805-c66916f9f375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d8a6d22-5137-494f-9805-c66916f9f375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ca1467-0337-4cbc-8cf1-711d7be6a0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ca1467-0337-4cbc-8cf1-711d7be6a0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d93276a-fd51-45ce-a065-87b5863df2f9', 'volume_name': 'volume-3d93276a-fd51-45ce-a065-87b5863df2f9', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (200783e9-02a0-4ffe-b9da-e4c04704880e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (200783e9-02a0-4ffe-b9da-e4c04704880e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2420211f-4ec8-4e65-8e3c-a80c460d5908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:14 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] Volume 3d93276a-fd51-45ce-a065-87b5863df2f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d93276a-fd51-45ce-a065-87b5863df2f9', 'volume_size': 1} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-275872108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d93276a-fd51-45ce-a065-87b5863df2f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='292c7664e8d0464b8d760da18a48ef96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:56:15Z,use_quota=True,user_id='2116daf9106f417f838ea1e496129378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] Creating volume 3d93276a-fd51-45ce-a065-87b5863df2f9 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:56:14 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:56:14 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:14 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9 1073741824 Jul 17 19:56:14 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:15 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0b260db3-64aa-42c6-918b-3bc659f0741f tempest-ProjectReaderTests-1417432126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83.a6bee88d-805e-4640-b98f-dabe8d38046e" returned: 0 in 0.389s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-0b260db3-64aa-42c6-918b-3bc659f0741f tempest-ProjectReaderTests-1417432126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:56:15 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c63a717-713f-439d-a488-96ddc6b13347]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0b260db3-64aa-42c6-918b-3bc659f0741f tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:15 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83 Jul 17 19:56:15 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:15 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9 1073741824" returned: 0 in 0.446s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:56:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:56:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:56:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:15 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:56:15 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:15 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9 Jul 17 19:56:15 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:15 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0b260db3-64aa-42c6-918b-3bc659f0741f tempest-ProjectReaderTests-1417432126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83" returned: 0 in 0.394s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0b260db3-64aa-42c6-918b-3bc659f0741f tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83.a6bee88d-805e-4640-b98f-dabe8d38046e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:15 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83.a6bee88d-805e-4640-b98f-dabe8d38046e Jul 17 19:56:15 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:15 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.280s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:15 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:56:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager._thread_info {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:56:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread count: 29 {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 19:56:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread info: [<_MainThread(MainThread, started 130066227544192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 19:56:15 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9" returned: 0 in 0.272s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:56:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2420211f-4ec8-4e65-8e3c-a80c460d5908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d93276a-fd51-45ce-a065-87b5863df2f9', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d4ad076-8eb5-4dab-8f49-824113618355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:15 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] Volume volume-3d93276a-fd51-45ce-a065-87b5863df2f9 (3d93276a-fd51-45ce-a065-87b5863df2f9): created successfully Jul 17 19:56:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d4ad076-8eb5-4dab-8f49-824113618355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] Flow 'volume_create_manager' (3fbe3a94-348b-453a-8de9-01b61d879ce0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:56:15 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-546e0fe9-1f70-49d9-849e-c070db624535 tempest-ProjectMemberTests-1057790160 None] Created volume successfully. Jul 17 19:56:15 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0b260db3-64aa-42c6-918b-3bc659f0741f tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83.a6bee88d-805e-4640-b98f-dabe8d38046e" returned: 0 in 0.339s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0b260db3-64aa-42c6-918b-3bc659f0741f tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83.a6bee88d-805e-4640-b98f-dabe8d38046e {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:15 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83.a6bee88d-805e-4640-b98f-dabe8d38046e Jul 17 19:56:15 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:16 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0b260db3-64aa-42c6-918b-3bc659f0741f tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83.a6bee88d-805e-4640-b98f-dabe8d38046e" returned: 0 in 0.237s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0b260db3-64aa-42c6-918b-3bc659f0741f tempest-ProjectReaderTests-1417432126 None] Lock "cinder-quobyte-a6bee88d-805e-4640-b98f-dabe8d38046e" released by "_delete_snapshot" :: held 1.451s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0b260db3-64aa-42c6-918b-3bc659f0741f tempest-ProjectReaderTests-1417432126 None] Lock "cinder-quobyte-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83" released by "delete_snapshot" :: held 1.481s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:16 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-0b260db3-64aa-42c6-918b-3bc659f0741f tempest-ProjectReaderTests-1417432126 None] Created reservations ['f1a8ca7f-d5c1-4662-974b-a7e565ee09c5', '8a00b060-0d0d-4a83-9389-929304142147', '1d7b7600-374f-4fac-afcd-59a635e6edab', '634a5597-dcc8-40b9-bd07-e20442f5e7ac'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:56:16 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-0b260db3-64aa-42c6-918b-3bc659f0741f tempest-ProjectReaderTests-1417432126 None] Delete snapshot completed successfully. Jul 17 19:56:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0b260db3-64aa-42c6-918b-3bc659f0741f tempest-ProjectReaderTests-1417432126 None] Lock "cinder-a6bee88d-805e-4640-b98f-dabe8d38046e-delete_snapshot" released by "delete_snapshot" :: held 1.620s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-065670af-31a5-456c-a144-02628f056201 tempest-ProjectReaderTests-1417432126 None] Acquiring lock "cinder-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-065670af-31a5-456c-a144-02628f056201 tempest-ProjectReaderTests-1417432126 None] Lock "cinder-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-065670af-31a5-456c-a144-02628f056201 tempest-ProjectReaderTests-1417432126 None] Acquiring lock "cinder-quobyte-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:16 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-065670af-31a5-456c-a144-02628f056201 tempest-ProjectReaderTests-1417432126 None] Lock "cinder-quobyte-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83" acquired by "delete_volume" :: waited 0.014s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:16 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a24925b-69f4-4c76-8619-596ff82708c8]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:16 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-065670af-31a5-456c-a144-02628f056201 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:17 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83 Jul 17 19:56:17 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a49e297d-49a9-40d7-964f-469ad6ede88e tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a49e297d-49a9-40d7-964f-469ad6ede88e tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:17 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-a49e297d-49a9-40d7-964f-469ad6ede88e tempest-ProjectMemberTests-1057790160 None] Creating offline snapshot c11965b2-25d1-45a3-997f-45b8178a0fff of volume 3d93276a-fd51-45ce-a065-87b5863df2f9 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:56:17 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e981c7a-a760-43c2-8476-237f8536d541]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a49e297d-49a9-40d7-964f-469ad6ede88e tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:17 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9 Jul 17 19:56:17 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:17 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-065670af-31a5-456c-a144-02628f056201 tempest-ProjectReaderTests-1417432126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83" returned: 0 in 0.368s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-065670af-31a5-456c-a144-02628f056201 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:17 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83 Jul 17 19:56:17 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:17 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a49e297d-49a9-40d7-964f-469ad6ede88e tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9" returned: 0 in 0.359s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a49e297d-49a9-40d7-964f-469ad6ede88e tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9.c11965b2-25d1-45a3-997f-45b8178a0fff 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:17 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9.c11965b2-25d1-45a3-997f-45b8178a0fff 1G Jul 17 19:56:17 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:17 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-065670af-31a5-456c-a144-02628f056201 tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83" returned: 0 in 0.250s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:17 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-065670af-31a5-456c-a144-02628f056201 tempest-ProjectReaderTests-1417432126 None] Lock "cinder-quobyte-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83" released by "delete_volume" :: held 0.684s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:17 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-065670af-31a5-456c-a144-02628f056201 tempest-ProjectReaderTests-1417432126 None] Created reservations ['ee761c61-fe4f-4875-9600-bc1e354def2b', '8f3ab92a-4efe-4fc0-a6ba-f758258877d6', '3d5a4f2e-bb30-4ca6-8490-ae15f7025034', 'da0cb7fa-1970-44ad-bbfd-fb5e2aec15c7'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:56:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-065670af-31a5-456c-a144-02628f056201 tempest-ProjectReaderTests-1417432126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-065670af-31a5-456c-a144-02628f056201 tempest-ProjectReaderTests-1417432126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:17 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-065670af-31a5-456c-a144-02628f056201 tempest-ProjectReaderTests-1417432126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:56:17 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-065670af-31a5-456c-a144-02628f056201 tempest-ProjectReaderTests-1417432126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:56:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-065670af-31a5-456c-a144-02628f056201 tempest-ProjectReaderTests-1417432126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-065670af-31a5-456c-a144-02628f056201 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:17 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:56:17 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:17 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a49e297d-49a9-40d7-964f-469ad6ede88e tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9.c11965b2-25d1-45a3-997f-45b8178a0fff 1G" returned: 0 in 0.400s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a49e297d-49a9-40d7-964f-469ad6ede88e tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d93276a-fd51-45ce-a065-87b5863df2f9 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9.c11965b2-25d1-45a3-997f-45b8178a0fff {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:17 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d93276a-fd51-45ce-a065-87b5863df2f9 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9.c11965b2-25d1-45a3-997f-45b8178a0fff Jul 17 19:56:17 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:17 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:17 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-065670af-31a5-456c-a144-02628f056201 tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.253s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:17 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-065670af-31a5-456c-a144-02628f056201 tempest-ProjectReaderTests-1417432126 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:56:17 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-065670af-31a5-456c-a144-02628f056201 tempest-ProjectReaderTests-1417432126 None] Deleted volume successfully. Jul 17 19:56:17 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-065670af-31a5-456c-a144-02628f056201 tempest-ProjectReaderTests-1417432126 None] Lock "cinder-cd5027af-e8e4-41f1-8e57-0cb92f2c2b83-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:18 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a49e297d-49a9-40d7-964f-469ad6ede88e tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d93276a-fd51-45ce-a065-87b5863df2f9 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9.c11965b2-25d1-45a3-997f-45b8178a0fff" returned: 0 in 0.316s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:18 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-a49e297d-49a9-40d7-964f-469ad6ede88e tempest-ProjectMemberTests-1057790160 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9.c11965b2-25d1-45a3-997f-45b8178a0fff is being set with open permissions: ugo+rw Jul 17 19:56:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a49e297d-49a9-40d7-964f-469ad6ede88e tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9.c11965b2-25d1-45a3-997f-45b8178a0fff {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:18 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9.c11965b2-25d1-45a3-997f-45b8178a0fff Jul 17 19:56:18 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:18 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a49e297d-49a9-40d7-964f-469ad6ede88e tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9.c11965b2-25d1-45a3-997f-45b8178a0fff" returned: 0 in 0.247s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:18 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:56:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] Flow 'volume_create_manager' (2c7bc388-9ebe-4d4f-9287-5445117d2e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:56:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f37e1725-0f9d-4f88-9781-0e849d30cc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a49e297d-49a9-40d7-964f-469ad6ede88e tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f37e1725-0f9d-4f88-9781-0e849d30cc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-148989094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45af5869-5407-42f3-ba4d-76f88516deae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71095797784d46b09417263dda7b10b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:56:18Z,use_quota=True,user_id='7118f39efbcc489fad07aff13da7edfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b228985c-f432-45dd-bebb-8d79705aea45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:18 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9.info Jul 17 19:56:18 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b228985c-f432-45dd-bebb-8d79705aea45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6091f2a9-b340-48f1-b08f-9e5fead85014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6091f2a9-b340-48f1-b08f-9e5fead85014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45af5869-5407-42f3-ba4d-76f88516deae', 'volume_name': 'volume-45af5869-5407-42f3-ba4d-76f88516deae', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20bd3f32-0e96-4e8d-8ecb-f45eb18d66df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20bd3f32-0e96-4e8d-8ecb-f45eb18d66df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:18 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a4ad9b-6c8d-4aeb-9067-37b065e21f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:18 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] Volume 45af5869-5407-42f3-ba4d-76f88516deae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45af5869-5407-42f3-ba4d-76f88516deae', 'volume_size': 1} Jul 17 19:56:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:18 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a49e297d-49a9-40d7-964f-469ad6ede88e tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9.info" returned: 0 in 0.252s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:18 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-a49e297d-49a9-40d7-964f-469ad6ede88e tempest-ProjectMemberTests-1057790160 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9.info is being set with open permissions: ugo+rw Jul 17 19:56:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a49e297d-49a9-40d7-964f-469ad6ede88e tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:18 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9.info Jul 17 19:56:18 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:18 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-a49e297d-49a9-40d7-964f-469ad6ede88e tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9.info" returned: 0 in 0.233s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-a49e297d-49a9-40d7-964f-469ad6ede88e tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.919s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.449s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:18 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-148989094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45af5869-5407-42f3-ba4d-76f88516deae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71095797784d46b09417263dda7b10b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:56:18Z,use_quota=True,user_id='7118f39efbcc489fad07aff13da7edfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:56:18 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] Creating volume 45af5869-5407-42f3-ba4d-76f88516deae {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:56:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:18 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:56:18 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:56:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:18 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:56:18 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:56:18 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:19 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae 1073741824 Jul 17 19:56:19 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:19 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-a49e297d-49a9-40d7-964f-469ad6ede88e tempest-ProjectMemberTests-1057790160 None] Create snapshot completed successfully Jul 17 19:56:19 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-91bd270e-9af6-4b37-b8cc-35c864d906c0 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-c11965b2-25d1-45a3-997f-45b8178a0fff-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:19 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-91bd270e-9af6-4b37-b8cc-35c864d906c0 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-c11965b2-25d1-45a3-997f-45b8178a0fff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:19 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-91bd270e-9af6-4b37-b8cc-35c864d906c0 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-quobyte-3d93276a-fd51-45ce-a065-87b5863df2f9" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:19 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-91bd270e-9af6-4b37-b8cc-35c864d906c0 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-3d93276a-fd51-45ce-a065-87b5863df2f9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:19 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-91bd270e-9af6-4b37-b8cc-35c864d906c0 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-quobyte-c11965b2-25d1-45a3-997f-45b8178a0fff" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:19 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-91bd270e-9af6-4b37-b8cc-35c864d906c0 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-c11965b2-25d1-45a3-997f-45b8178a0fff" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:19 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-91bd270e-9af6-4b37-b8cc-35c864d906c0 tempest-ProjectMemberTests-1057790160 None] Deleting offline snapshot c11965b2-25d1-45a3-997f-45b8178a0fff of volume 3d93276a-fd51-45ce-a065-87b5863df2f9 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:56:19 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-91bd270e-9af6-4b37-b8cc-35c864d906c0 tempest-ProjectMemberTests-1057790160 None] snapshot_file for this snap is: volume-3d93276a-fd51-45ce-a065-87b5863df2f9.c11965b2-25d1-45a3-997f-45b8178a0fff {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:56:19 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbb82ee-9efb-454e-94a5-cdaeaf82a31e]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-91bd270e-9af6-4b37-b8cc-35c864d906c0 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9.c11965b2-25d1-45a3-997f-45b8178a0fff {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:19 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9.c11965b2-25d1-45a3-997f-45b8178a0fff Jul 17 19:56:19 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:19 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae 1073741824" returned: 0 in 0.453s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:19 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae Jul 17 19:56:19 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:19 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-91bd270e-9af6-4b37-b8cc-35c864d906c0 tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9.c11965b2-25d1-45a3-997f-45b8178a0fff" returned: 0 in 0.371s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:19 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-91bd270e-9af6-4b37-b8cc-35c864d906c0 tempest-ProjectMemberTests-1057790160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d93276a-fd51-45ce-a065-87b5863df2f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:56:19 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbf5568-e3e4-402f-bdfe-039dda9ed132]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-91bd270e-9af6-4b37-b8cc-35c864d906c0 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:19 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae" returned: 0 in 0.258s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:19 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:56:19 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a4ad9b-6c8d-4aeb-9067-37b065e21f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45af5869-5407-42f3-ba4d-76f88516deae', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91ec5308-203f-4bb7-9b60-d408d7212ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:19 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] Volume volume-45af5869-5407-42f3-ba4d-76f88516deae (45af5869-5407-42f3-ba4d-76f88516deae): created successfully Jul 17 19:56:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91ec5308-203f-4bb7-9b60-d408d7212ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:19 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] Flow 'volume_create_manager' (2c7bc388-9ebe-4d4f-9287-5445117d2e6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:56:19 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-4865924f-012f-4655-875f-3d2dc573ab6a tempest-ProjectReaderTests-1417432126 None] Created volume successfully. Jul 17 19:56:19 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9 Jul 17 19:56:19 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:20 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-91bd270e-9af6-4b37-b8cc-35c864d906c0 tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9" returned: 0 in 0.355s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-91bd270e-9af6-4b37-b8cc-35c864d906c0 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9.c11965b2-25d1-45a3-997f-45b8178a0fff {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:20 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9.c11965b2-25d1-45a3-997f-45b8178a0fff Jul 17 19:56:20 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:20 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-91bd270e-9af6-4b37-b8cc-35c864d906c0 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9.c11965b2-25d1-45a3-997f-45b8178a0fff" returned: 0 in 0.316s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-91bd270e-9af6-4b37-b8cc-35c864d906c0 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9.c11965b2-25d1-45a3-997f-45b8178a0fff {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:20 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9.c11965b2-25d1-45a3-997f-45b8178a0fff Jul 17 19:56:20 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:20 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-91bd270e-9af6-4b37-b8cc-35c864d906c0 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9.c11965b2-25d1-45a3-997f-45b8178a0fff" returned: 0 in 0.258s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:20 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-91bd270e-9af6-4b37-b8cc-35c864d906c0 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-c11965b2-25d1-45a3-997f-45b8178a0fff" released by "_delete_snapshot" :: held 1.400s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-bb0d877e-42de-4a3e-8af2-8776bb4e87cf tempest-ProjectReaderTests-1417432126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-bb0d877e-42de-4a3e-8af2-8776bb4e87cf tempest-ProjectReaderTests-1417432126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:20 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-91bd270e-9af6-4b37-b8cc-35c864d906c0 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-3d93276a-fd51-45ce-a065-87b5863df2f9" released by "delete_snapshot" :: held 1.427s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:20 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-bb0d877e-42de-4a3e-8af2-8776bb4e87cf tempest-ProjectReaderTests-1417432126 None] Creating offline snapshot 1f3fcff4-9418-4190-94b7-16ded427e398 of volume 45af5869-5407-42f3-ba4d-76f88516deae {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:56:20 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[955d79e7-6f02-4d70-999f-30bb808df583]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:20 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bb0d877e-42de-4a3e-8af2-8776bb4e87cf tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:20 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-91bd270e-9af6-4b37-b8cc-35c864d906c0 tempest-ProjectMemberTests-1057790160 None] Created reservations ['18748f77-7fa8-42c7-8c7a-644a79c401f3', '15ee1964-1aab-42cc-8ece-849441aa0911', 'f7a3cabb-45c1-4560-9451-abb332035827', '6de3742c-68e2-4f54-896e-f2c7adac331d'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:56:20 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-91bd270e-9af6-4b37-b8cc-35c864d906c0 tempest-ProjectMemberTests-1057790160 None] Delete snapshot completed successfully. Jul 17 19:56:20 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-91bd270e-9af6-4b37-b8cc-35c864d906c0 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-c11965b2-25d1-45a3-997f-45b8178a0fff-delete_snapshot" released by "delete_snapshot" :: held 1.584s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:20 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae Jul 17 19:56:20 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:21 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bb0d877e-42de-4a3e-8af2-8776bb4e87cf tempest-ProjectReaderTests-1417432126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae" returned: 0 in 0.371s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bb0d877e-42de-4a3e-8af2-8776bb4e87cf tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae.1f3fcff4-9418-4190-94b7-16ded427e398 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:21 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae.1f3fcff4-9418-4190-94b7-16ded427e398 1G Jul 17 19:56:21 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:21 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f053ca2d-c17d-4010-a479-4674f77de57c tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-3d93276a-fd51-45ce-a065-87b5863df2f9-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:21 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f053ca2d-c17d-4010-a479-4674f77de57c tempest-ProjectMemberTests-1057790160 None] Lock "cinder-3d93276a-fd51-45ce-a065-87b5863df2f9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:21 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f053ca2d-c17d-4010-a479-4674f77de57c tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-quobyte-3d93276a-fd51-45ce-a065-87b5863df2f9" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:21 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f053ca2d-c17d-4010-a479-4674f77de57c tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-3d93276a-fd51-45ce-a065-87b5863df2f9" acquired by "delete_volume" :: waited 0.016s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:21 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[266965dd-74c0-472f-82fc-d2f5f3309a21]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f053ca2d-c17d-4010-a479-4674f77de57c tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:21 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bb0d877e-42de-4a3e-8af2-8776bb4e87cf tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae.1f3fcff4-9418-4190-94b7-16ded427e398 1G" returned: 0 in 0.438s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bb0d877e-42de-4a3e-8af2-8776bb4e87cf tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45af5869-5407-42f3-ba4d-76f88516deae -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae.1f3fcff4-9418-4190-94b7-16ded427e398 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:21 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45af5869-5407-42f3-ba4d-76f88516deae -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae.1f3fcff4-9418-4190-94b7-16ded427e398 Jul 17 19:56:21 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:21 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9 Jul 17 19:56:21 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:21 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bb0d877e-42de-4a3e-8af2-8776bb4e87cf tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45af5869-5407-42f3-ba4d-76f88516deae -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae.1f3fcff4-9418-4190-94b7-16ded427e398" returned: 0 in 0.311s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:21 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-bb0d877e-42de-4a3e-8af2-8776bb4e87cf tempest-ProjectReaderTests-1417432126 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae.1f3fcff4-9418-4190-94b7-16ded427e398 is being set with open permissions: ugo+rw Jul 17 19:56:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bb0d877e-42de-4a3e-8af2-8776bb4e87cf tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae.1f3fcff4-9418-4190-94b7-16ded427e398 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:21 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f053ca2d-c17d-4010-a479-4674f77de57c tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9" returned: 0 in 0.362s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:21 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f053ca2d-c17d-4010-a479-4674f77de57c tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:21 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae.1f3fcff4-9418-4190-94b7-16ded427e398 Jul 17 19:56:21 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:21 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9 Jul 17 19:56:21 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:22 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bb0d877e-42de-4a3e-8af2-8776bb4e87cf tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae.1f3fcff4-9418-4190-94b7-16ded427e398" returned: 0 in 0.240s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bb0d877e-42de-4a3e-8af2-8776bb4e87cf tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:22 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f053ca2d-c17d-4010-a479-4674f77de57c tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3d93276a-fd51-45ce-a065-87b5863df2f9" returned: 0 in 0.253s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:22 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae.info Jul 17 19:56:22 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f053ca2d-c17d-4010-a479-4674f77de57c tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-3d93276a-fd51-45ce-a065-87b5863df2f9" released by "delete_volume" :: held 0.678s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:22 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-f053ca2d-c17d-4010-a479-4674f77de57c tempest-ProjectMemberTests-1057790160 None] Created reservations ['0656cdf4-446f-49f7-80e8-d658b4fe1d9e', '188b3d40-4070-4e9c-9cd9-a2611549a2da', '6856ae22-2c50-4e8e-a344-1ce780456650', 'f7995ed7-47c4-4aee-8e8c-f070960d3cb6'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:56:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f053ca2d-c17d-4010-a479-4674f77de57c tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f053ca2d-c17d-4010-a479-4674f77de57c tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-f053ca2d-c17d-4010-a479-4674f77de57c tempest-ProjectMemberTests-1057790160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:56:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-f053ca2d-c17d-4010-a479-4674f77de57c tempest-ProjectMemberTests-1057790160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:56:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-f053ca2d-c17d-4010-a479-4674f77de57c tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f053ca2d-c17d-4010-a479-4674f77de57c tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:22 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:56:22 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:22 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bb0d877e-42de-4a3e-8af2-8776bb4e87cf tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae.info" returned: 0 in 0.258s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:22 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-bb0d877e-42de-4a3e-8af2-8776bb4e87cf tempest-ProjectReaderTests-1417432126 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae.info is being set with open permissions: ugo+rw Jul 17 19:56:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bb0d877e-42de-4a3e-8af2-8776bb4e87cf tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:22 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae.info Jul 17 19:56:22 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:22 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-f053ca2d-c17d-4010-a479-4674f77de57c tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.264s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:22 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-f053ca2d-c17d-4010-a479-4674f77de57c tempest-ProjectMemberTests-1057790160 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:56:22 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-f053ca2d-c17d-4010-a479-4674f77de57c tempest-ProjectMemberTests-1057790160 None] Deleted volume successfully. Jul 17 19:56:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-f053ca2d-c17d-4010-a479-4674f77de57c tempest-ProjectMemberTests-1057790160 None] Lock "cinder-3d93276a-fd51-45ce-a065-87b5863df2f9-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:22 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bb0d877e-42de-4a3e-8af2-8776bb4e87cf tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae.info" returned: 0 in 0.265s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-bb0d877e-42de-4a3e-8af2-8776bb4e87cf tempest-ProjectReaderTests-1417432126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.961s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:22 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-bb0d877e-42de-4a3e-8af2-8776bb4e87cf tempest-ProjectReaderTests-1417432126 None] Create snapshot completed successfully Jul 17 19:56:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7354cfd0-bbf2-4d5a-9940-576b5caebdec tempest-ProjectReaderTests-1417432126 None] Acquiring lock "cinder-1f3fcff4-9418-4190-94b7-16ded427e398-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7354cfd0-bbf2-4d5a-9940-576b5caebdec tempest-ProjectReaderTests-1417432126 None] Lock "cinder-1f3fcff4-9418-4190-94b7-16ded427e398-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7354cfd0-bbf2-4d5a-9940-576b5caebdec tempest-ProjectReaderTests-1417432126 None] Acquiring lock "cinder-quobyte-45af5869-5407-42f3-ba4d-76f88516deae" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7354cfd0-bbf2-4d5a-9940-576b5caebdec tempest-ProjectReaderTests-1417432126 None] Lock "cinder-quobyte-45af5869-5407-42f3-ba4d-76f88516deae" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7354cfd0-bbf2-4d5a-9940-576b5caebdec tempest-ProjectReaderTests-1417432126 None] Acquiring lock "cinder-quobyte-1f3fcff4-9418-4190-94b7-16ded427e398" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:22 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7354cfd0-bbf2-4d5a-9940-576b5caebdec tempest-ProjectReaderTests-1417432126 None] Lock "cinder-quobyte-1f3fcff4-9418-4190-94b7-16ded427e398" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-7354cfd0-bbf2-4d5a-9940-576b5caebdec tempest-ProjectReaderTests-1417432126 None] Deleting offline snapshot 1f3fcff4-9418-4190-94b7-16ded427e398 of volume 45af5869-5407-42f3-ba4d-76f88516deae {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:56:22 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-7354cfd0-bbf2-4d5a-9940-576b5caebdec tempest-ProjectReaderTests-1417432126 None] snapshot_file for this snap is: volume-45af5869-5407-42f3-ba4d-76f88516deae.1f3fcff4-9418-4190-94b7-16ded427e398 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:56:22 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ce4f42-65d1-44a9-afae-126efe0ba9dd]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:22 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7354cfd0-bbf2-4d5a-9940-576b5caebdec tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae.1f3fcff4-9418-4190-94b7-16ded427e398 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:23 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae.1f3fcff4-9418-4190-94b7-16ded427e398 Jul 17 19:56:23 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] Flow 'volume_create_manager' (b37ef88e-2953-46d5-a309-e1dd50843b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f4cfe06-38c3-49f9-9378-6fa1c075a7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f4cfe06-38c3-49f9-9378-6fa1c075a7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2013135376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7537bd6-8226-4988-87c4-1d27635d89ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='292c7664e8d0464b8d760da18a48ef96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:56:23Z,use_quota=True,user_id='2116daf9106f417f838ea1e496129378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8350d60-d8e2-453a-904e-14495e7271e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8350d60-d8e2-453a-904e-14495e7271e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3113e7c-3ba1-42cf-a059-d8a3b4f4727c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3113e7c-3ba1-42cf-a059-d8a3b4f4727c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7537bd6-8226-4988-87c4-1d27635d89ac', 'volume_name': 'volume-b7537bd6-8226-4988-87c4-1d27635d89ac', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d7e8481-de12-4d18-868e-3137f4421372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d7e8481-de12-4d18-868e-3137f4421372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da47701c-88b2-494b-92cd-7a2000d3cea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:23 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] Volume b7537bd6-8226-4988-87c4-1d27635d89ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7537bd6-8226-4988-87c4-1d27635d89ac', 'volume_size': 1} Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2013135376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7537bd6-8226-4988-87c4-1d27635d89ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='292c7664e8d0464b8d760da18a48ef96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:56:23Z,use_quota=True,user_id='2116daf9106f417f838ea1e496129378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] Creating volume b7537bd6-8226-4988-87c4-1d27635d89ac {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:56:23 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:23 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac 1073741824 Jul 17 19:56:23 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:23 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7354cfd0-bbf2-4d5a-9940-576b5caebdec tempest-ProjectReaderTests-1417432126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae.1f3fcff4-9418-4190-94b7-16ded427e398" returned: 0 in 0.367s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-7354cfd0-bbf2-4d5a-9940-576b5caebdec tempest-ProjectReaderTests-1417432126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45af5869-5407-42f3-ba4d-76f88516deae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8f941b-a2fe-476e-8df8-e972a80a0cd8]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7354cfd0-bbf2-4d5a-9940-576b5caebdec tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:23 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae Jul 17 19:56:23 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:23 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac 1073741824" returned: 0 in 0.419s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:23 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac Jul 17 19:56:23 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:23 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7354cfd0-bbf2-4d5a-9940-576b5caebdec tempest-ProjectReaderTests-1417432126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae" returned: 0 in 0.369s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7354cfd0-bbf2-4d5a-9940-576b5caebdec tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae.1f3fcff4-9418-4190-94b7-16ded427e398 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:23 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae.1f3fcff4-9418-4190-94b7-16ded427e398 Jul 17 19:56:23 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:23 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac" returned: 0 in 0.249s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da47701c-88b2-494b-92cd-7a2000d3cea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7537bd6-8226-4988-87c4-1d27635d89ac', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c41abdcf-0e72-40e1-8acd-89514440e51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:23 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] Volume volume-b7537bd6-8226-4988-87c4-1d27635d89ac (b7537bd6-8226-4988-87c4-1d27635d89ac): created successfully Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c41abdcf-0e72-40e1-8acd-89514440e51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:23 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] Flow 'volume_create_manager' (b37ef88e-2953-46d5-a309-e1dd50843b8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:56:23 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-ca7a3159-6a21-4127-9962-e7ed8a2e169c tempest-ProjectMemberTests-1057790160 None] Created volume successfully. Jul 17 19:56:24 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7354cfd0-bbf2-4d5a-9940-576b5caebdec tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae.1f3fcff4-9418-4190-94b7-16ded427e398" returned: 0 in 0.386s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7354cfd0-bbf2-4d5a-9940-576b5caebdec tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae.1f3fcff4-9418-4190-94b7-16ded427e398 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:24 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae.1f3fcff4-9418-4190-94b7-16ded427e398 Jul 17 19:56:24 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-42860805-4618-4967-953b-f2462560310b tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-42860805-4618-4967-953b-f2462560310b tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:24 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-42860805-4618-4967-953b-f2462560310b tempest-ProjectMemberTests-1057790160 None] Creating offline snapshot f40dd1ed-7ca1-43e1-b8ca-eb084cb7475b of volume b7537bd6-8226-4988-87c4-1d27635d89ac {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:56:24 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[82976d4d-1a92-4db3-b48d-95050dcc7b4c]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-42860805-4618-4967-953b-f2462560310b tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:24 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-7354cfd0-bbf2-4d5a-9940-576b5caebdec tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae.1f3fcff4-9418-4190-94b7-16ded427e398" returned: 0 in 0.271s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:24 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac Jul 17 19:56:24 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:24 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7354cfd0-bbf2-4d5a-9940-576b5caebdec tempest-ProjectReaderTests-1417432126 None] Lock "cinder-quobyte-1f3fcff4-9418-4190-94b7-16ded427e398" released by "_delete_snapshot" :: held 1.504s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:24 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7354cfd0-bbf2-4d5a-9940-576b5caebdec tempest-ProjectReaderTests-1417432126 None] Lock "cinder-quobyte-45af5869-5407-42f3-ba4d-76f88516deae" released by "delete_snapshot" :: held 1.530s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:24 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-7354cfd0-bbf2-4d5a-9940-576b5caebdec tempest-ProjectReaderTests-1417432126 None] Created reservations ['5e4ff730-ce1b-4a5f-ac8b-396397c6c2dc', '93974e11-09f9-4876-90ae-119a53c2d805', '64a078c3-5e42-4983-aece-c2a84f0cd547', 'e2c67af5-1534-4c14-8d7f-ce1b3d1471b0'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:56:24 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-7354cfd0-bbf2-4d5a-9940-576b5caebdec tempest-ProjectReaderTests-1417432126 None] Delete snapshot completed successfully. Jul 17 19:56:24 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-7354cfd0-bbf2-4d5a-9940-576b5caebdec tempest-ProjectReaderTests-1417432126 None] Lock "cinder-1f3fcff4-9418-4190-94b7-16ded427e398-delete_snapshot" released by "delete_snapshot" :: held 1.669s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:24 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-42860805-4618-4967-953b-f2462560310b tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac" returned: 0 in 0.362s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:24 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-42860805-4618-4967-953b-f2462560310b tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac.f40dd1ed-7ca1-43e1-b8ca-eb084cb7475b 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:24 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac.f40dd1ed-7ca1-43e1-b8ca-eb084cb7475b 1G Jul 17 19:56:24 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:24 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c9358c0c-5026-43ed-a2f3-98f183d807ea tempest-ProjectReaderTests-1417432126 None] Acquiring lock "cinder-45af5869-5407-42f3-ba4d-76f88516deae-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:24 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c9358c0c-5026-43ed-a2f3-98f183d807ea tempest-ProjectReaderTests-1417432126 None] Lock "cinder-45af5869-5407-42f3-ba4d-76f88516deae-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:25 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c9358c0c-5026-43ed-a2f3-98f183d807ea tempest-ProjectReaderTests-1417432126 None] Acquiring lock "cinder-quobyte-45af5869-5407-42f3-ba4d-76f88516deae" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:25 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-42860805-4618-4967-953b-f2462560310b tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac.f40dd1ed-7ca1-43e1-b8ca-eb084cb7475b 1G" returned: 0 in 0.439s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-42860805-4618-4967-953b-f2462560310b tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7537bd6-8226-4988-87c4-1d27635d89ac -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac.f40dd1ed-7ca1-43e1-b8ca-eb084cb7475b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:25 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c9358c0c-5026-43ed-a2f3-98f183d807ea tempest-ProjectReaderTests-1417432126 None] Lock "cinder-quobyte-45af5869-5407-42f3-ba4d-76f88516deae" acquired by "delete_volume" :: waited 0.027s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:25 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7537bd6-8226-4988-87c4-1d27635d89ac -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac.f40dd1ed-7ca1-43e1-b8ca-eb084cb7475b Jul 17 19:56:25 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:25 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff993b2-96e5-42b0-9926-c0322e538330]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c9358c0c-5026-43ed-a2f3-98f183d807ea tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:25 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae Jul 17 19:56:25 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:25 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-42860805-4618-4967-953b-f2462560310b tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7537bd6-8226-4988-87c4-1d27635d89ac -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac.f40dd1ed-7ca1-43e1-b8ca-eb084cb7475b" returned: 0 in 0.288s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:25 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-42860805-4618-4967-953b-f2462560310b tempest-ProjectMemberTests-1057790160 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac.f40dd1ed-7ca1-43e1-b8ca-eb084cb7475b is being set with open permissions: ugo+rw Jul 17 19:56:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-42860805-4618-4967-953b-f2462560310b tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac.f40dd1ed-7ca1-43e1-b8ca-eb084cb7475b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:25 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac.f40dd1ed-7ca1-43e1-b8ca-eb084cb7475b Jul 17 19:56:25 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:25 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c9358c0c-5026-43ed-a2f3-98f183d807ea tempest-ProjectReaderTests-1417432126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae" returned: 0 in 0.362s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c9358c0c-5026-43ed-a2f3-98f183d807ea tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:25 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae Jul 17 19:56:25 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:25 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-42860805-4618-4967-953b-f2462560310b tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac.f40dd1ed-7ca1-43e1-b8ca-eb084cb7475b" returned: 0 in 0.247s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-42860805-4618-4967-953b-f2462560310b tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:25 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac.info Jul 17 19:56:25 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:25 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c9358c0c-5026-43ed-a2f3-98f183d807ea tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-45af5869-5407-42f3-ba4d-76f88516deae" returned: 0 in 0.255s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:25 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c9358c0c-5026-43ed-a2f3-98f183d807ea tempest-ProjectReaderTests-1417432126 None] Lock "cinder-quobyte-45af5869-5407-42f3-ba4d-76f88516deae" released by "delete_volume" :: held 0.684s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:25 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-c9358c0c-5026-43ed-a2f3-98f183d807ea tempest-ProjectReaderTests-1417432126 None] Created reservations ['7772711d-2e0c-4529-a1f5-a748713c97ff', '2f911629-c33b-463b-a6b2-c06d10856eed', 'eaa89260-c0f7-4ed8-bf83-8614737a64c6', 'b50380fd-cc42-47ee-80fb-2616ea6095c9'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:56:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c9358c0c-5026-43ed-a2f3-98f183d807ea tempest-ProjectReaderTests-1417432126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c9358c0c-5026-43ed-a2f3-98f183d807ea tempest-ProjectReaderTests-1417432126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c9358c0c-5026-43ed-a2f3-98f183d807ea tempest-ProjectReaderTests-1417432126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:56:25 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:25 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c9358c0c-5026-43ed-a2f3-98f183d807ea tempest-ProjectReaderTests-1417432126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:56:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c9358c0c-5026-43ed-a2f3-98f183d807ea tempest-ProjectReaderTests-1417432126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c9358c0c-5026-43ed-a2f3-98f183d807ea tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-42860805-4618-4967-953b-f2462560310b tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac.info" returned: 0 in 0.268s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:25 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-42860805-4618-4967-953b-f2462560310b tempest-ProjectMemberTests-1057790160 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac.info is being set with open permissions: ugo+rw Jul 17 19:56:25 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-42860805-4618-4967-953b-f2462560310b tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:25 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:56:25 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:25 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac.info Jul 17 19:56:25 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:26 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:26 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c9358c0c-5026-43ed-a2f3-98f183d807ea tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.251s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-c9358c0c-5026-43ed-a2f3-98f183d807ea tempest-ProjectReaderTests-1417432126 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-42860805-4618-4967-953b-f2462560310b tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac.info" returned: 0 in 0.244s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-42860805-4618-4967-953b-f2462560310b tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.931s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:26 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-c9358c0c-5026-43ed-a2f3-98f183d807ea tempest-ProjectReaderTests-1417432126 None] Deleted volume successfully. Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-c9358c0c-5026-43ed-a2f3-98f183d807ea tempest-ProjectReaderTests-1417432126 None] Lock "cinder-45af5869-5407-42f3-ba4d-76f88516deae-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:26 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-42860805-4618-4967-953b-f2462560310b tempest-ProjectMemberTests-1057790160 None] Create snapshot completed successfully Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-fca62dea-18b4-49c2-8cb4-97ae72239c9f tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-f40dd1ed-7ca1-43e1-b8ca-eb084cb7475b-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-fca62dea-18b4-49c2-8cb4-97ae72239c9f tempest-ProjectMemberTests-1057790160 None] Lock "cinder-f40dd1ed-7ca1-43e1-b8ca-eb084cb7475b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-fca62dea-18b4-49c2-8cb4-97ae72239c9f tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-quobyte-b7537bd6-8226-4988-87c4-1d27635d89ac" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-fca62dea-18b4-49c2-8cb4-97ae72239c9f tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-b7537bd6-8226-4988-87c4-1d27635d89ac" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-fca62dea-18b4-49c2-8cb4-97ae72239c9f tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-quobyte-f40dd1ed-7ca1-43e1-b8ca-eb084cb7475b" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-fca62dea-18b4-49c2-8cb4-97ae72239c9f tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-f40dd1ed-7ca1-43e1-b8ca-eb084cb7475b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-fca62dea-18b4-49c2-8cb4-97ae72239c9f tempest-ProjectMemberTests-1057790160 None] Deleting offline snapshot f40dd1ed-7ca1-43e1-b8ca-eb084cb7475b of volume b7537bd6-8226-4988-87c4-1d27635d89ac {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-fca62dea-18b4-49c2-8cb4-97ae72239c9f tempest-ProjectMemberTests-1057790160 None] snapshot_file for this snap is: volume-b7537bd6-8226-4988-87c4-1d27635d89ac.f40dd1ed-7ca1-43e1-b8ca-eb084cb7475b {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0065cb-448f-4786-ae8b-e840fe0f20e3]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fca62dea-18b4-49c2-8cb4-97ae72239c9f tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac.f40dd1ed-7ca1-43e1-b8ca-eb084cb7475b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:26 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac.f40dd1ed-7ca1-43e1-b8ca-eb084cb7475b Jul 17 19:56:26 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] Flow 'volume_create_manager' (eccec418-18cf-48a2-8e26-1ef025cecd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b635df-535b-4873-af20-6bb83e1d09d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b635df-535b-4873-af20-6bb83e1d09d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1145130759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=323b3f4d-1f23-44d9-857f-cede5c002a39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71095797784d46b09417263dda7b10b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:56:27Z,use_quota=True,user_id='7118f39efbcc489fad07aff13da7edfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a910dc12-b397-4def-92d6-e6a13e07852c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a910dc12-b397-4def-92d6-e6a13e07852c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f4d7a1-0f1a-4408-a83e-1112a507ee7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f4d7a1-0f1a-4408-a83e-1112a507ee7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '323b3f4d-1f23-44d9-857f-cede5c002a39', 'volume_name': 'volume-323b3f4d-1f23-44d9-857f-cede5c002a39', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d7c5182-a0eb-45e2-8d99-b0088ce52111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d7c5182-a0eb-45e2-8d99-b0088ce52111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54378004-94a7-41ae-b288-b8075cd89dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:26 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] Volume 323b3f4d-1f23-44d9-857f-cede5c002a39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-323b3f4d-1f23-44d9-857f-cede5c002a39', 'volume_size': 1} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1145130759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=323b3f4d-1f23-44d9-857f-cede5c002a39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71095797784d46b09417263dda7b10b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:56:27Z,use_quota=True,user_id='7118f39efbcc489fad07aff13da7edfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] Creating volume 323b3f4d-1f23-44d9-857f-cede5c002a39 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:56:26 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:26 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39 1073741824 Jul 17 19:56:26 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:26 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fca62dea-18b4-49c2-8cb4-97ae72239c9f tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac.f40dd1ed-7ca1-43e1-b8ca-eb084cb7475b" returned: 0 in 0.373s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-fca62dea-18b4-49c2-8cb4-97ae72239c9f tempest-ProjectMemberTests-1057790160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7537bd6-8226-4988-87c4-1d27635d89ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eaf2ec6-debc-4e8a-bf98-98e3a4727a40]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:26 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fca62dea-18b4-49c2-8cb4-97ae72239c9f tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:26 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac Jul 17 19:56:26 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:27 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39 1073741824" returned: 0 in 0.398s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:27 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39 Jul 17 19:56:27 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:27 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fca62dea-18b4-49c2-8cb4-97ae72239c9f tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac" returned: 0 in 0.362s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fca62dea-18b4-49c2-8cb4-97ae72239c9f tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac.f40dd1ed-7ca1-43e1-b8ca-eb084cb7475b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:27 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac.f40dd1ed-7ca1-43e1-b8ca-eb084cb7475b Jul 17 19:56:27 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:27 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39" returned: 0 in 0.262s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:27 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:56:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:27 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54378004-94a7-41ae-b288-b8075cd89dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-323b3f4d-1f23-44d9-857f-cede5c002a39', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:27 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba37418-8bfc-4ae9-a418-32beda9e026f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:27 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] Volume volume-323b3f4d-1f23-44d9-857f-cede5c002a39 (323b3f4d-1f23-44d9-857f-cede5c002a39): created successfully Jul 17 19:56:27 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba37418-8bfc-4ae9-a418-32beda9e026f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:27 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] Flow 'volume_create_manager' (eccec418-18cf-48a2-8e26-1ef025cecd3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:56:27 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-347fc5c8-ede6-4848-b9b7-f358fe616d4a tempest-ProjectReaderTests-1417432126 None] Created volume successfully. Jul 17 19:56:27 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fca62dea-18b4-49c2-8cb4-97ae72239c9f tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac.f40dd1ed-7ca1-43e1-b8ca-eb084cb7475b" returned: 0 in 0.346s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fca62dea-18b4-49c2-8cb4-97ae72239c9f tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac.f40dd1ed-7ca1-43e1-b8ca-eb084cb7475b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:27 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac.f40dd1ed-7ca1-43e1-b8ca-eb084cb7475b Jul 17 19:56:27 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ae1dd9a6-6172-42d7-b982-569c17bcc947 tempest-ProjectReaderTests-1417432126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ae1dd9a6-6172-42d7-b982-569c17bcc947 tempest-ProjectReaderTests-1417432126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:27 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-ae1dd9a6-6172-42d7-b982-569c17bcc947 tempest-ProjectReaderTests-1417432126 None] Creating offline snapshot 8279de7d-9baf-49d2-bfc2-8c80baa2a3b2 of volume 323b3f4d-1f23-44d9-857f-cede5c002a39 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:56:27 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[6244de91-795a-4983-b719-6a01b0298bdf]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ae1dd9a6-6172-42d7-b982-569c17bcc947 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:27 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:27 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-fca62dea-18b4-49c2-8cb4-97ae72239c9f tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac.f40dd1ed-7ca1-43e1-b8ca-eb084cb7475b" returned: 0 in 0.300s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-fca62dea-18b4-49c2-8cb4-97ae72239c9f tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-f40dd1ed-7ca1-43e1-b8ca-eb084cb7475b" released by "_delete_snapshot" :: held 1.493s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:27 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-fca62dea-18b4-49c2-8cb4-97ae72239c9f tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-b7537bd6-8226-4988-87c4-1d27635d89ac" released by "delete_snapshot" :: held 1.519s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:27 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-fca62dea-18b4-49c2-8cb4-97ae72239c9f tempest-ProjectMemberTests-1057790160 None] Created reservations ['77391dc5-afb0-48c1-bda2-bea68fc94cd8', '8b181230-b64d-4ba6-9405-a3c73cdb68b3', 'e9838971-a492-4e5b-a321-751d516761d3', '29cd90b5-695b-4472-8329-8f2aea6674b3'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:56:27 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39 Jul 17 19:56:27 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:28 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-fca62dea-18b4-49c2-8cb4-97ae72239c9f tempest-ProjectMemberTests-1057790160 None] Delete snapshot completed successfully. Jul 17 19:56:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-fca62dea-18b4-49c2-8cb4-97ae72239c9f tempest-ProjectMemberTests-1057790160 None] Lock "cinder-f40dd1ed-7ca1-43e1-b8ca-eb084cb7475b-delete_snapshot" released by "delete_snapshot" :: held 1.656s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:28 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ae1dd9a6-6172-42d7-b982-569c17bcc947 tempest-ProjectReaderTests-1417432126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39" returned: 0 in 0.361s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ae1dd9a6-6172-42d7-b982-569c17bcc947 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39.8279de7d-9baf-49d2-bfc2-8c80baa2a3b2 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:28 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39.8279de7d-9baf-49d2-bfc2-8c80baa2a3b2 1G Jul 17 19:56:28 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-078e4e21-e440-4f64-964d-8579f2f526a8 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-b7537bd6-8226-4988-87c4-1d27635d89ac-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-078e4e21-e440-4f64-964d-8579f2f526a8 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-b7537bd6-8226-4988-87c4-1d27635d89ac-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-078e4e21-e440-4f64-964d-8579f2f526a8 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-quobyte-b7537bd6-8226-4988-87c4-1d27635d89ac" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:28 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-078e4e21-e440-4f64-964d-8579f2f526a8 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-b7537bd6-8226-4988-87c4-1d27635d89ac" acquired by "delete_volume" :: waited 0.016s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:28 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b8de59-56b6-450a-9f60-39471628742d]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-078e4e21-e440-4f64-964d-8579f2f526a8 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:28 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ae1dd9a6-6172-42d7-b982-569c17bcc947 tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39.8279de7d-9baf-49d2-bfc2-8c80baa2a3b2 1G" returned: 0 in 0.422s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ae1dd9a6-6172-42d7-b982-569c17bcc947 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-323b3f4d-1f23-44d9-857f-cede5c002a39 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39.8279de7d-9baf-49d2-bfc2-8c80baa2a3b2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:28 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-323b3f4d-1f23-44d9-857f-cede5c002a39 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39.8279de7d-9baf-49d2-bfc2-8c80baa2a3b2 Jul 17 19:56:28 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:28 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac Jul 17 19:56:28 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:28 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ae1dd9a6-6172-42d7-b982-569c17bcc947 tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-323b3f4d-1f23-44d9-857f-cede5c002a39 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39.8279de7d-9baf-49d2-bfc2-8c80baa2a3b2" returned: 0 in 0.297s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:28 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-ae1dd9a6-6172-42d7-b982-569c17bcc947 tempest-ProjectReaderTests-1417432126 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39.8279de7d-9baf-49d2-bfc2-8c80baa2a3b2 is being set with open permissions: ugo+rw Jul 17 19:56:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ae1dd9a6-6172-42d7-b982-569c17bcc947 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39.8279de7d-9baf-49d2-bfc2-8c80baa2a3b2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:28 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39.8279de7d-9baf-49d2-bfc2-8c80baa2a3b2 Jul 17 19:56:28 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:28 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-078e4e21-e440-4f64-964d-8579f2f526a8 tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac" returned: 0 in 0.365s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:28 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-078e4e21-e440-4f64-964d-8579f2f526a8 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:29 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac Jul 17 19:56:29 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:29 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ae1dd9a6-6172-42d7-b982-569c17bcc947 tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39.8279de7d-9baf-49d2-bfc2-8c80baa2a3b2" returned: 0 in 0.243s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ae1dd9a6-6172-42d7-b982-569c17bcc947 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:29 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39.info Jul 17 19:56:29 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:29 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-078e4e21-e440-4f64-964d-8579f2f526a8 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b7537bd6-8226-4988-87c4-1d27635d89ac" returned: 0 in 0.257s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-078e4e21-e440-4f64-964d-8579f2f526a8 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-b7537bd6-8226-4988-87c4-1d27635d89ac" released by "delete_volume" :: held 0.686s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:29 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-078e4e21-e440-4f64-964d-8579f2f526a8 tempest-ProjectMemberTests-1057790160 None] Created reservations ['5c5ddf3b-9728-432e-9a52-8e96560fc1a3', '665bb0f4-f1cd-49b1-9e12-a1400a5737cc', 'ebb9a68c-1f1e-4e62-8eb4-f68e30946902', '7d1c2164-8c15-4d50-9882-3db9050ce822'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:56:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-078e4e21-e440-4f64-964d-8579f2f526a8 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-078e4e21-e440-4f64-964d-8579f2f526a8 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:29 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-078e4e21-e440-4f64-964d-8579f2f526a8 tempest-ProjectMemberTests-1057790160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:56:29 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-078e4e21-e440-4f64-964d-8579f2f526a8 tempest-ProjectMemberTests-1057790160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:56:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-078e4e21-e440-4f64-964d-8579f2f526a8 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-078e4e21-e440-4f64-964d-8579f2f526a8 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:29 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:56:29 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:29 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ae1dd9a6-6172-42d7-b982-569c17bcc947 tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39.info" returned: 0 in 0.266s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:29 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-ae1dd9a6-6172-42d7-b982-569c17bcc947 tempest-ProjectReaderTests-1417432126 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39.info is being set with open permissions: ugo+rw Jul 17 19:56:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ae1dd9a6-6172-42d7-b982-569c17bcc947 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:29 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39.info Jul 17 19:56:29 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:29 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-078e4e21-e440-4f64-964d-8579f2f526a8 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.266s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:29 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-078e4e21-e440-4f64-964d-8579f2f526a8 tempest-ProjectMemberTests-1057790160 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:56:29 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-078e4e21-e440-4f64-964d-8579f2f526a8 tempest-ProjectMemberTests-1057790160 None] Deleted volume successfully. Jul 17 19:56:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-078e4e21-e440-4f64-964d-8579f2f526a8 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-b7537bd6-8226-4988-87c4-1d27635d89ac-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:29 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ae1dd9a6-6172-42d7-b982-569c17bcc947 tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39.info" returned: 0 in 0.259s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:29 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ae1dd9a6-6172-42d7-b982-569c17bcc947 tempest-ProjectReaderTests-1417432126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.951s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:29 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-ae1dd9a6-6172-42d7-b982-569c17bcc947 tempest-ProjectReaderTests-1417432126 None] Create snapshot completed successfully Jul 17 19:56:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-71f0c247-d9de-4ca2-b7e8-6d1ba4c07974 tempest-ProjectReaderTests-1417432126 None] Acquiring lock "cinder-8279de7d-9baf-49d2-bfc2-8c80baa2a3b2-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-71f0c247-d9de-4ca2-b7e8-6d1ba4c07974 tempest-ProjectReaderTests-1417432126 None] Lock "cinder-8279de7d-9baf-49d2-bfc2-8c80baa2a3b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-71f0c247-d9de-4ca2-b7e8-6d1ba4c07974 tempest-ProjectReaderTests-1417432126 None] Acquiring lock "cinder-quobyte-323b3f4d-1f23-44d9-857f-cede5c002a39" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-71f0c247-d9de-4ca2-b7e8-6d1ba4c07974 tempest-ProjectReaderTests-1417432126 None] Lock "cinder-quobyte-323b3f4d-1f23-44d9-857f-cede5c002a39" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:29 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-71f0c247-d9de-4ca2-b7e8-6d1ba4c07974 tempest-ProjectReaderTests-1417432126 None] Acquiring lock "cinder-quobyte-8279de7d-9baf-49d2-bfc2-8c80baa2a3b2" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-71f0c247-d9de-4ca2-b7e8-6d1ba4c07974 tempest-ProjectReaderTests-1417432126 None] Lock "cinder-quobyte-8279de7d-9baf-49d2-bfc2-8c80baa2a3b2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-71f0c247-d9de-4ca2-b7e8-6d1ba4c07974 tempest-ProjectReaderTests-1417432126 None] Deleting offline snapshot 8279de7d-9baf-49d2-bfc2-8c80baa2a3b2 of volume 323b3f4d-1f23-44d9-857f-cede5c002a39 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-71f0c247-d9de-4ca2-b7e8-6d1ba4c07974 tempest-ProjectReaderTests-1417432126 None] snapshot_file for this snap is: volume-323b3f4d-1f23-44d9-857f-cede5c002a39.8279de7d-9baf-49d2-bfc2-8c80baa2a3b2 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b126e8-bb09-41e6-b87d-bf15368e3820]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-71f0c247-d9de-4ca2-b7e8-6d1ba4c07974 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39.8279de7d-9baf-49d2-bfc2-8c80baa2a3b2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] Flow 'volume_create_manager' (8fb6bbc3-3f83-4e6f-bef7-4d292201ec04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:56:30 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39.8279de7d-9baf-49d2-bfc2-8c80baa2a3b2 Jul 17 19:56:30 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3efd4a64-f715-411b-bdbe-d14e440d0f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3efd4a64-f715-411b-bdbe-d14e440d0f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-429987822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db67af2e-ae45-42ff-aaec-cdfeed4b4570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='292c7664e8d0464b8d760da18a48ef96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:56:30Z,use_quota=True,user_id='2116daf9106f417f838ea1e496129378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (071ea955-fa4e-4ffa-a728-91c4557fab19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (071ea955-fa4e-4ffa-a728-91c4557fab19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dfd7909-6034-4556-ba98-992352041345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dfd7909-6034-4556-ba98-992352041345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db67af2e-ae45-42ff-aaec-cdfeed4b4570', 'volume_name': 'volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (012a3ea5-0e7f-4d59-8e62-4e42e0c37359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (012a3ea5-0e7f-4d59-8e62-4e42e0c37359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bdbc4c2-1a2f-4b5e-b75c-db5883e077e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:30 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] Volume db67af2e-ae45-42ff-aaec-cdfeed4b4570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570', 'volume_size': 1} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-429987822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db67af2e-ae45-42ff-aaec-cdfeed4b4570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='292c7664e8d0464b8d760da18a48ef96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:56:30Z,use_quota=True,user_id='2116daf9106f417f838ea1e496129378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] Creating volume db67af2e-ae45-42ff-aaec-cdfeed4b4570 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:56:30 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:30 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570 1073741824 Jul 17 19:56:30 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:30 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-71f0c247-d9de-4ca2-b7e8-6d1ba4c07974 tempest-ProjectReaderTests-1417432126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39.8279de7d-9baf-49d2-bfc2-8c80baa2a3b2" returned: 0 in 0.363s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-71f0c247-d9de-4ca2-b7e8-6d1ba4c07974 tempest-ProjectReaderTests-1417432126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-323b3f4d-1f23-44d9-857f-cede5c002a39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0aec8c-13ed-4f8a-b184-8edba827f5f8]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-71f0c247-d9de-4ca2-b7e8-6d1ba4c07974 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:30 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39 Jul 17 19:56:30 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:30 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570 1073741824" returned: 0 in 0.416s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:30 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570 Jul 17 19:56:30 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:30 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-71f0c247-d9de-4ca2-b7e8-6d1ba4c07974 tempest-ProjectReaderTests-1417432126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39" returned: 0 in 0.365s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-71f0c247-d9de-4ca2-b7e8-6d1ba4c07974 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39.8279de7d-9baf-49d2-bfc2-8c80baa2a3b2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:30 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39.8279de7d-9baf-49d2-bfc2-8c80baa2a3b2 Jul 17 19:56:30 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:30 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570" returned: 0 in 0.246s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bdbc4c2-1a2f-4b5e-b75c-db5883e077e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3738d19-bacd-4f48-8ee5-ac23a7ede234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:30 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] Volume volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570 (db67af2e-ae45-42ff-aaec-cdfeed4b4570): created successfully Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3738d19-bacd-4f48-8ee5-ac23a7ede234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:30 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] Flow 'volume_create_manager' (8fb6bbc3-3f83-4e6f-bef7-4d292201ec04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:56:31 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-c240af35-e298-4c58-af75-f33e7ec2960d tempest-ProjectMemberTests-1057790160 None] Created volume successfully. Jul 17 19:56:31 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-71f0c247-d9de-4ca2-b7e8-6d1ba4c07974 tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39.8279de7d-9baf-49d2-bfc2-8c80baa2a3b2" returned: 0 in 0.330s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-71f0c247-d9de-4ca2-b7e8-6d1ba4c07974 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39.8279de7d-9baf-49d2-bfc2-8c80baa2a3b2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:31 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39.8279de7d-9baf-49d2-bfc2-8c80baa2a3b2 Jul 17 19:56:31 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b0cbe708-0471-44dd-8907-6cace8340e1f tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b0cbe708-0471-44dd-8907-6cace8340e1f tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:31 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-b0cbe708-0471-44dd-8907-6cace8340e1f tempest-ProjectMemberTests-1057790160 None] Creating offline snapshot 4fa70255-46c2-432b-a237-b5fa794a0e2c of volume db67af2e-ae45-42ff-aaec-cdfeed4b4570 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:56:31 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[a269dd95-95f9-46fa-a1b1-973c3239d46c]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b0cbe708-0471-44dd-8907-6cace8340e1f tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:31 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-71f0c247-d9de-4ca2-b7e8-6d1ba4c07974 tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39.8279de7d-9baf-49d2-bfc2-8c80baa2a3b2" returned: 0 in 0.248s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:31 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-71f0c247-d9de-4ca2-b7e8-6d1ba4c07974 tempest-ProjectReaderTests-1417432126 None] Lock "cinder-quobyte-8279de7d-9baf-49d2-bfc2-8c80baa2a3b2" released by "_delete_snapshot" :: held 1.393s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:31 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-71f0c247-d9de-4ca2-b7e8-6d1ba4c07974 tempest-ProjectReaderTests-1417432126 None] Lock "cinder-quobyte-323b3f4d-1f23-44d9-857f-cede5c002a39" released by "delete_snapshot" :: held 1.419s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:31 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570 Jul 17 19:56:31 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:31 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-71f0c247-d9de-4ca2-b7e8-6d1ba4c07974 tempest-ProjectReaderTests-1417432126 None] Created reservations ['0144f003-1f44-42b4-9880-68dfc29f763d', 'fecb5ceb-cbc4-40bc-940a-d6d9d3b4bbe0', '330f9c98-4951-4c1f-beec-77dd6f614c44', '00231429-a454-4645-b859-13ca3e08ad4a'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:56:31 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-71f0c247-d9de-4ca2-b7e8-6d1ba4c07974 tempest-ProjectReaderTests-1417432126 None] Delete snapshot completed successfully. Jul 17 19:56:31 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-71f0c247-d9de-4ca2-b7e8-6d1ba4c07974 tempest-ProjectReaderTests-1417432126 None] Lock "cinder-8279de7d-9baf-49d2-bfc2-8c80baa2a3b2-delete_snapshot" released by "delete_snapshot" :: held 1.563s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:31 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b0cbe708-0471-44dd-8907-6cace8340e1f tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570" returned: 0 in 0.353s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:31 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b0cbe708-0471-44dd-8907-6cace8340e1f tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570.4fa70255-46c2-432b-a237-b5fa794a0e2c 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:31 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570.4fa70255-46c2-432b-a237-b5fa794a0e2c 1G Jul 17 19:56:31 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:32 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b0cbe708-0471-44dd-8907-6cace8340e1f tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570.4fa70255-46c2-432b-a237-b5fa794a0e2c 1G" returned: 0 in 0.380s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b0cbe708-0471-44dd-8907-6cace8340e1f tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570.4fa70255-46c2-432b-a237-b5fa794a0e2c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:32 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e7aff750-9ed5-4e6f-b737-74f29ccf7d04 tempest-ProjectReaderTests-1417432126 None] Acquiring lock "cinder-323b3f4d-1f23-44d9-857f-cede5c002a39-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:32 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570.4fa70255-46c2-432b-a237-b5fa794a0e2c Jul 17 19:56:32 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:32 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e7aff750-9ed5-4e6f-b737-74f29ccf7d04 tempest-ProjectReaderTests-1417432126 None] Lock "cinder-323b3f4d-1f23-44d9-857f-cede5c002a39-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:32 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e7aff750-9ed5-4e6f-b737-74f29ccf7d04 tempest-ProjectReaderTests-1417432126 None] Acquiring lock "cinder-quobyte-323b3f4d-1f23-44d9-857f-cede5c002a39" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:32 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e7aff750-9ed5-4e6f-b737-74f29ccf7d04 tempest-ProjectReaderTests-1417432126 None] Lock "cinder-quobyte-323b3f4d-1f23-44d9-857f-cede5c002a39" acquired by "delete_volume" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:32 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e5cccf-50ad-4aa5-9d32-e20b7f4fb4e8]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e7aff750-9ed5-4e6f-b737-74f29ccf7d04 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:32 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39 Jul 17 19:56:32 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:32 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b0cbe708-0471-44dd-8907-6cace8340e1f tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570.4fa70255-46c2-432b-a237-b5fa794a0e2c" returned: 0 in 0.303s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:32 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-b0cbe708-0471-44dd-8907-6cace8340e1f tempest-ProjectMemberTests-1057790160 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570.4fa70255-46c2-432b-a237-b5fa794a0e2c is being set with open permissions: ugo+rw Jul 17 19:56:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b0cbe708-0471-44dd-8907-6cace8340e1f tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570.4fa70255-46c2-432b-a237-b5fa794a0e2c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:32 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570.4fa70255-46c2-432b-a237-b5fa794a0e2c Jul 17 19:56:32 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:32 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e7aff750-9ed5-4e6f-b737-74f29ccf7d04 tempest-ProjectReaderTests-1417432126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39" returned: 0 in 0.378s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e7aff750-9ed5-4e6f-b737-74f29ccf7d04 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:32 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39 Jul 17 19:56:32 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:32 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b0cbe708-0471-44dd-8907-6cace8340e1f tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570.4fa70255-46c2-432b-a237-b5fa794a0e2c" returned: 0 in 0.245s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b0cbe708-0471-44dd-8907-6cace8340e1f tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:32 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570.info Jul 17 19:56:32 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:32 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e7aff750-9ed5-4e6f-b737-74f29ccf7d04 tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-323b3f4d-1f23-44d9-857f-cede5c002a39" returned: 0 in 0.261s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:32 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e7aff750-9ed5-4e6f-b737-74f29ccf7d04 tempest-ProjectReaderTests-1417432126 None] Lock "cinder-quobyte-323b3f4d-1f23-44d9-857f-cede5c002a39" released by "delete_volume" :: held 0.699s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:32 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b0cbe708-0471-44dd-8907-6cace8340e1f tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570.info" returned: 0 in 0.260s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:32 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-b0cbe708-0471-44dd-8907-6cace8340e1f tempest-ProjectMemberTests-1057790160 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570.info is being set with open permissions: ugo+rw Jul 17 19:56:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b0cbe708-0471-44dd-8907-6cace8340e1f tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:32 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570.info Jul 17 19:56:32 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:32 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-e7aff750-9ed5-4e6f-b737-74f29ccf7d04 tempest-ProjectReaderTests-1417432126 None] Created reservations ['34a2e4c6-f388-4de5-9208-24708f5ace92', 'f1bb84b5-ddf8-4037-b616-ec0263db9455', 'e6f1a1f7-3a4d-4169-85ac-93893b3f6380', '7ae4cc5f-46a9-4110-b2e1-811ee589f4c7'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e7aff750-9ed5-4e6f-b737-74f29ccf7d04 tempest-ProjectReaderTests-1417432126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e7aff750-9ed5-4e6f-b737-74f29ccf7d04 tempest-ProjectReaderTests-1417432126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e7aff750-9ed5-4e6f-b737-74f29ccf7d04 tempest-ProjectReaderTests-1417432126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e7aff750-9ed5-4e6f-b737-74f29ccf7d04 tempest-ProjectReaderTests-1417432126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e7aff750-9ed5-4e6f-b737-74f29ccf7d04 tempest-ProjectReaderTests-1417432126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e7aff750-9ed5-4e6f-b737-74f29ccf7d04 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:33 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:56:33 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:33 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-b0cbe708-0471-44dd-8907-6cace8340e1f tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570.info" returned: 0 in 0.254s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-b0cbe708-0471-44dd-8907-6cace8340e1f tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.888s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:33 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-b0cbe708-0471-44dd-8907-6cace8340e1f tempest-ProjectMemberTests-1057790160 None] Create snapshot completed successfully Jul 17 19:56:33 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e7aff750-9ed5-4e6f-b737-74f29ccf7d04 tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.263s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-e7aff750-9ed5-4e6f-b737-74f29ccf7d04 tempest-ProjectReaderTests-1417432126 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:56:33 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e7aff750-9ed5-4e6f-b737-74f29ccf7d04 tempest-ProjectReaderTests-1417432126 None] Deleted volume successfully. Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e7aff750-9ed5-4e6f-b737-74f29ccf7d04 tempest-ProjectReaderTests-1417432126 None] Lock "cinder-323b3f4d-1f23-44d9-857f-cede5c002a39-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0c60ac68-9dc9-4213-b17a-b34243d99ed8 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-4fa70255-46c2-432b-a237-b5fa794a0e2c-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0c60ac68-9dc9-4213-b17a-b34243d99ed8 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-4fa70255-46c2-432b-a237-b5fa794a0e2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0c60ac68-9dc9-4213-b17a-b34243d99ed8 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-quobyte-db67af2e-ae45-42ff-aaec-cdfeed4b4570" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0c60ac68-9dc9-4213-b17a-b34243d99ed8 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-db67af2e-ae45-42ff-aaec-cdfeed4b4570" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0c60ac68-9dc9-4213-b17a-b34243d99ed8 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-quobyte-4fa70255-46c2-432b-a237-b5fa794a0e2c" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0c60ac68-9dc9-4213-b17a-b34243d99ed8 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-4fa70255-46c2-432b-a237-b5fa794a0e2c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-0c60ac68-9dc9-4213-b17a-b34243d99ed8 tempest-ProjectMemberTests-1057790160 None] Deleting offline snapshot 4fa70255-46c2-432b-a237-b5fa794a0e2c of volume db67af2e-ae45-42ff-aaec-cdfeed4b4570 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-0c60ac68-9dc9-4213-b17a-b34243d99ed8 tempest-ProjectMemberTests-1057790160 None] snapshot_file for this snap is: volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570.4fa70255-46c2-432b-a237-b5fa794a0e2c {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[d285bc76-fb8c-4c2f-8f61-21fb1d986eff]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0c60ac68-9dc9-4213-b17a-b34243d99ed8 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570.4fa70255-46c2-432b-a237-b5fa794a0e2c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:33 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570.4fa70255-46c2-432b-a237-b5fa794a0e2c Jul 17 19:56:33 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] Flow 'volume_create_manager' (f6555c92-50b2-45e2-84ba-44c3fbfc97bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe90cda0-727b-46a4-ba5c-f77bcebe3eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe90cda0-727b-46a4-ba5c-f77bcebe3eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1291711626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8180ef86-71e4-4e6d-8487-9b8bb1507cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71095797784d46b09417263dda7b10b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:56:34Z,use_quota=True,user_id='7118f39efbcc489fad07aff13da7edfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e0aa56-6e24-4b4d-a1b4-215b655b5c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e0aa56-6e24-4b4d-a1b4-215b655b5c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9574b8b1-485c-4890-90f1-7bfa556acd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9574b8b1-485c-4890-90f1-7bfa556acd13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8180ef86-71e4-4e6d-8487-9b8bb1507cb5', 'volume_name': 'volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf1d4855-104f-4292-9fff-04a5b8ff316e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf1d4855-104f-4292-9fff-04a5b8ff316e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9ab00e5-4f6b-4ca8-a140-b000d71e6858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:33 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] Volume 8180ef86-71e4-4e6d-8487-9b8bb1507cb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5', 'volume_size': 1} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1291711626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8180ef86-71e4-4e6d-8487-9b8bb1507cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71095797784d46b09417263dda7b10b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:56:34Z,use_quota=True,user_id='7118f39efbcc489fad07aff13da7edfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] Creating volume 8180ef86-71e4-4e6d-8487-9b8bb1507cb5 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:56:33 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:33 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5 1073741824 Jul 17 19:56:33 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:33 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0c60ac68-9dc9-4213-b17a-b34243d99ed8 tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570.4fa70255-46c2-432b-a237-b5fa794a0e2c" returned: 0 in 0.392s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-0c60ac68-9dc9-4213-b17a-b34243d99ed8 tempest-ProjectMemberTests-1057790160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd05079-96f8-4c11-b49b-aae8f9fe6ea0]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0c60ac68-9dc9-4213-b17a-b34243d99ed8 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:34 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570 Jul 17 19:56:34 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:34 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5 1073741824" returned: 0 in 0.411s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:34 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5 Jul 17 19:56:34 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:34 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0c60ac68-9dc9-4213-b17a-b34243d99ed8 tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570" returned: 0 in 0.375s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0c60ac68-9dc9-4213-b17a-b34243d99ed8 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570.4fa70255-46c2-432b-a237-b5fa794a0e2c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:34 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570.4fa70255-46c2-432b-a237-b5fa794a0e2c Jul 17 19:56:34 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:34 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5" returned: 0 in 0.250s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:34 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:56:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9ab00e5-4f6b-4ca8-a140-b000d71e6858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06ab3bb4-2e98-4d00-bd6f-8af0775ec3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:34 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] Volume volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5 (8180ef86-71e4-4e6d-8487-9b8bb1507cb5): created successfully Jul 17 19:56:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06ab3bb4-2e98-4d00-bd6f-8af0775ec3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:34 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] Flow 'volume_create_manager' (f6555c92-50b2-45e2-84ba-44c3fbfc97bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:56:34 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-3b6b563d-de52-4c96-940f-705d6912bf22 tempest-ProjectReaderTests-1417432126 None] Created volume successfully. Jul 17 19:56:34 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0c60ac68-9dc9-4213-b17a-b34243d99ed8 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570.4fa70255-46c2-432b-a237-b5fa794a0e2c" returned: 0 in 0.353s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0c60ac68-9dc9-4213-b17a-b34243d99ed8 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570.4fa70255-46c2-432b-a237-b5fa794a0e2c {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:34 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570.4fa70255-46c2-432b-a237-b5fa794a0e2c Jul 17 19:56:34 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6a024f1f-0c1c-4045-8b65-bf058bf3437a tempest-ProjectReaderTests-1417432126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6a024f1f-0c1c-4045-8b65-bf058bf3437a tempest-ProjectReaderTests-1417432126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:34 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-6a024f1f-0c1c-4045-8b65-bf058bf3437a tempest-ProjectReaderTests-1417432126 None] Creating offline snapshot e1136a42-3168-47ee-8bdb-1902ec02fd6f of volume 8180ef86-71e4-4e6d-8487-9b8bb1507cb5 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:56:34 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0c60ac68-9dc9-4213-b17a-b34243d99ed8 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570.4fa70255-46c2-432b-a237-b5fa794a0e2c" returned: 0 in 0.261s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:34 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d70505-ac08-4387-8330-0cb62d402833]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6a024f1f-0c1c-4045-8b65-bf058bf3437a tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:35 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0c60ac68-9dc9-4213-b17a-b34243d99ed8 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-4fa70255-46c2-432b-a237-b5fa794a0e2c" released by "_delete_snapshot" :: held 1.493s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:35 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0c60ac68-9dc9-4213-b17a-b34243d99ed8 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-db67af2e-ae45-42ff-aaec-cdfeed4b4570" released by "delete_snapshot" :: held 1.519s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:35 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-0c60ac68-9dc9-4213-b17a-b34243d99ed8 tempest-ProjectMemberTests-1057790160 None] Created reservations ['599c1816-2536-432f-a1b7-93a506214f54', '841b94db-de7e-4d34-aa2c-c32340b29951', 'd7f00b84-9bb6-42d0-93cc-8ea0c8029b63', '9b83e9c5-baaa-49e6-9bae-a54c35ad9c2e'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:56:35 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5 Jul 17 19:56:35 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:35 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-0c60ac68-9dc9-4213-b17a-b34243d99ed8 tempest-ProjectMemberTests-1057790160 None] Delete snapshot completed successfully. Jul 17 19:56:35 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0c60ac68-9dc9-4213-b17a-b34243d99ed8 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-4fa70255-46c2-432b-a237-b5fa794a0e2c-delete_snapshot" released by "delete_snapshot" :: held 1.652s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:35 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6a024f1f-0c1c-4045-8b65-bf058bf3437a tempest-ProjectReaderTests-1417432126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5" returned: 0 in 0.347s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6a024f1f-0c1c-4045-8b65-bf058bf3437a tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5.e1136a42-3168-47ee-8bdb-1902ec02fd6f 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:35 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5.e1136a42-3168-47ee-8bdb-1902ec02fd6f 1G Jul 17 19:56:35 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:35 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-bacd7f36-6d8c-4bc5-a17b-06b58537d438 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-db67af2e-ae45-42ff-aaec-cdfeed4b4570-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:35 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-bacd7f36-6d8c-4bc5-a17b-06b58537d438 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-db67af2e-ae45-42ff-aaec-cdfeed4b4570-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:35 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-bacd7f36-6d8c-4bc5-a17b-06b58537d438 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-quobyte-db67af2e-ae45-42ff-aaec-cdfeed4b4570" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:35 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-bacd7f36-6d8c-4bc5-a17b-06b58537d438 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-db67af2e-ae45-42ff-aaec-cdfeed4b4570" acquired by "delete_volume" :: waited 0.017s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:35 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[f454b753-82b6-4c39-ba7a-9c5cd94910d3]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bacd7f36-6d8c-4bc5-a17b-06b58537d438 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:35 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6a024f1f-0c1c-4045-8b65-bf058bf3437a tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5.e1136a42-3168-47ee-8bdb-1902ec02fd6f 1G" returned: 0 in 0.483s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6a024f1f-0c1c-4045-8b65-bf058bf3437a tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5.e1136a42-3168-47ee-8bdb-1902ec02fd6f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:35 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5.e1136a42-3168-47ee-8bdb-1902ec02fd6f Jul 17 19:56:35 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:35 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570 Jul 17 19:56:35 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:36 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6a024f1f-0c1c-4045-8b65-bf058bf3437a tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5.e1136a42-3168-47ee-8bdb-1902ec02fd6f" returned: 0 in 0.291s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:36 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-6a024f1f-0c1c-4045-8b65-bf058bf3437a tempest-ProjectReaderTests-1417432126 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5.e1136a42-3168-47ee-8bdb-1902ec02fd6f is being set with open permissions: ugo+rw Jul 17 19:56:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6a024f1f-0c1c-4045-8b65-bf058bf3437a tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5.e1136a42-3168-47ee-8bdb-1902ec02fd6f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:36 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bacd7f36-6d8c-4bc5-a17b-06b58537d438 tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570" returned: 0 in 0.377s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bacd7f36-6d8c-4bc5-a17b-06b58537d438 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:36 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5.e1136a42-3168-47ee-8bdb-1902ec02fd6f Jul 17 19:56:36 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:36 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570 Jul 17 19:56:36 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:36 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6a024f1f-0c1c-4045-8b65-bf058bf3437a tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5.e1136a42-3168-47ee-8bdb-1902ec02fd6f" returned: 0 in 0.241s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:36 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6a024f1f-0c1c-4045-8b65-bf058bf3437a tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bacd7f36-6d8c-4bc5-a17b-06b58537d438 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-db67af2e-ae45-42ff-aaec-cdfeed4b4570" returned: 0 in 0.261s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:36 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5.info Jul 17 19:56:36 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-bacd7f36-6d8c-4bc5-a17b-06b58537d438 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-db67af2e-ae45-42ff-aaec-cdfeed4b4570" released by "delete_volume" :: held 0.704s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:36 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-bacd7f36-6d8c-4bc5-a17b-06b58537d438 tempest-ProjectMemberTests-1057790160 None] Created reservations ['b8b964e5-7d93-404c-840c-f40ed0b575c7', 'd94ad574-4b38-482e-b8e5-53abbb1320eb', '1e42824c-139c-4a57-a1c3-0c49e27b3402', 'd0cca5a0-cba3-4346-a10d-8f49b801b0f4'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:56:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-bacd7f36-6d8c-4bc5-a17b-06b58537d438 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-bacd7f36-6d8c-4bc5-a17b-06b58537d438 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-bacd7f36-6d8c-4bc5-a17b-06b58537d438 tempest-ProjectMemberTests-1057790160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:56:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-bacd7f36-6d8c-4bc5-a17b-06b58537d438 tempest-ProjectMemberTests-1057790160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:56:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-bacd7f36-6d8c-4bc5-a17b-06b58537d438 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bacd7f36-6d8c-4bc5-a17b-06b58537d438 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:36 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:56:36 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:36 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6a024f1f-0c1c-4045-8b65-bf058bf3437a tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5.info" returned: 0 in 0.263s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:36 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-6a024f1f-0c1c-4045-8b65-bf058bf3437a tempest-ProjectReaderTests-1417432126 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5.info is being set with open permissions: ugo+rw Jul 17 19:56:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6a024f1f-0c1c-4045-8b65-bf058bf3437a tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:36 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5.info Jul 17 19:56:36 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:36 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bacd7f36-6d8c-4bc5-a17b-06b58537d438 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.265s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:36 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-bacd7f36-6d8c-4bc5-a17b-06b58537d438 tempest-ProjectMemberTests-1057790160 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:56:36 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-bacd7f36-6d8c-4bc5-a17b-06b58537d438 tempest-ProjectMemberTests-1057790160 None] Deleted volume successfully. Jul 17 19:56:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-bacd7f36-6d8c-4bc5-a17b-06b58537d438 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-db67af2e-ae45-42ff-aaec-cdfeed4b4570-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:36 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-6a024f1f-0c1c-4045-8b65-bf058bf3437a tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5.info" returned: 0 in 0.252s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-6a024f1f-0c1c-4045-8b65-bf058bf3437a tempest-ProjectReaderTests-1417432126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.977s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:36 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-6a024f1f-0c1c-4045-8b65-bf058bf3437a tempest-ProjectReaderTests-1417432126 None] Create snapshot completed successfully Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e1182583-f1e5-4256-a6f0-8a48f87317db tempest-ProjectReaderTests-1417432126 None] Acquiring lock "cinder-e1136a42-3168-47ee-8bdb-1902ec02fd6f-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e1182583-f1e5-4256-a6f0-8a48f87317db tempest-ProjectReaderTests-1417432126 None] Lock "cinder-e1136a42-3168-47ee-8bdb-1902ec02fd6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e1182583-f1e5-4256-a6f0-8a48f87317db tempest-ProjectReaderTests-1417432126 None] Acquiring lock "cinder-quobyte-8180ef86-71e4-4e6d-8487-9b8bb1507cb5" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e1182583-f1e5-4256-a6f0-8a48f87317db tempest-ProjectReaderTests-1417432126 None] Lock "cinder-quobyte-8180ef86-71e4-4e6d-8487-9b8bb1507cb5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e1182583-f1e5-4256-a6f0-8a48f87317db tempest-ProjectReaderTests-1417432126 None] Acquiring lock "cinder-quobyte-e1136a42-3168-47ee-8bdb-1902ec02fd6f" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e1182583-f1e5-4256-a6f0-8a48f87317db tempest-ProjectReaderTests-1417432126 None] Lock "cinder-quobyte-e1136a42-3168-47ee-8bdb-1902ec02fd6f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-e1182583-f1e5-4256-a6f0-8a48f87317db tempest-ProjectReaderTests-1417432126 None] Deleting offline snapshot e1136a42-3168-47ee-8bdb-1902ec02fd6f of volume 8180ef86-71e4-4e6d-8487-9b8bb1507cb5 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-e1182583-f1e5-4256-a6f0-8a48f87317db tempest-ProjectReaderTests-1417432126 None] snapshot_file for this snap is: volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5.e1136a42-3168-47ee-8bdb-1902ec02fd6f {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[660de457-4c40-48a5-87e0-4502dc4406dd]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e1182583-f1e5-4256-a6f0-8a48f87317db tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5.e1136a42-3168-47ee-8bdb-1902ec02fd6f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] Flow 'volume_create_manager' (0b08a6bc-50da-49a3-bfd0-284c09b6a4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:56:37 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5.e1136a42-3168-47ee-8bdb-1902ec02fd6f Jul 17 19:56:37 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd69bb3-4795-4788-9f03-9d8c88a0d4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd69bb3-4795-4788-9f03-9d8c88a0d4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2015998016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b23060c4-4507-445a-8384-b6dbac521ac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='292c7664e8d0464b8d760da18a48ef96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:56:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:56:37Z,use_quota=True,user_id='2116daf9106f417f838ea1e496129378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (982181ef-8ad0-4ac3-af99-8c7ca97fc1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (982181ef-8ad0-4ac3-af99-8c7ca97fc1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508b7561-9f3b-4333-8550-59cfc7fa5e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508b7561-9f3b-4333-8550-59cfc7fa5e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b23060c4-4507-445a-8384-b6dbac521ac2', 'volume_name': 'volume-b23060c4-4507-445a-8384-b6dbac521ac2', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb85c4c-4b48-4949-91e5-f635e1346a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb85c4c-4b48-4949-91e5-f635e1346a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3840811a-0b57-44d6-8a1d-f680248b915d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:37 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] Volume b23060c4-4507-445a-8384-b6dbac521ac2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b23060c4-4507-445a-8384-b6dbac521ac2', 'volume_size': 1} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2015998016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b23060c4-4507-445a-8384-b6dbac521ac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='292c7664e8d0464b8d760da18a48ef96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:56:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:56:37Z,use_quota=True,user_id='2116daf9106f417f838ea1e496129378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] Creating volume b23060c4-4507-445a-8384-b6dbac521ac2 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:56:37 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:37 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2 1073741824 Jul 17 19:56:37 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:37 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e1182583-f1e5-4256-a6f0-8a48f87317db tempest-ProjectReaderTests-1417432126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5.e1136a42-3168-47ee-8bdb-1902ec02fd6f" returned: 0 in 0.360s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-e1182583-f1e5-4256-a6f0-8a48f87317db tempest-ProjectReaderTests-1417432126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d1ea73-1551-45d7-a12c-091a1b3b82bd]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e1182583-f1e5-4256-a6f0-8a48f87317db tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:37 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5 Jul 17 19:56:37 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:37 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2 1073741824" returned: 0 in 0.434s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:37 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2 Jul 17 19:56:37 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:37 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e1182583-f1e5-4256-a6f0-8a48f87317db tempest-ProjectReaderTests-1417432126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5" returned: 0 in 0.368s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e1182583-f1e5-4256-a6f0-8a48f87317db tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5.e1136a42-3168-47ee-8bdb-1902ec02fd6f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:37 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5.e1136a42-3168-47ee-8bdb-1902ec02fd6f Jul 17 19:56:37 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:38 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2" returned: 0 in 0.242s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:38 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:56:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3840811a-0b57-44d6-8a1d-f680248b915d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b23060c4-4507-445a-8384-b6dbac521ac2', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2bc6321-d821-4593-ad18-d7bc12f2ca9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:38 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] Volume volume-b23060c4-4507-445a-8384-b6dbac521ac2 (b23060c4-4507-445a-8384-b6dbac521ac2): created successfully Jul 17 19:56:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2bc6321-d821-4593-ad18-d7bc12f2ca9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:38 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] Flow 'volume_create_manager' (0b08a6bc-50da-49a3-bfd0-284c09b6a4e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:56:38 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-78c56499-892c-4165-8be0-fff8be744c05 tempest-ProjectMemberTests-1057790160 None] Created volume successfully. Jul 17 19:56:38 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e1182583-f1e5-4256-a6f0-8a48f87317db tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5.e1136a42-3168-47ee-8bdb-1902ec02fd6f" returned: 0 in 0.336s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e1182583-f1e5-4256-a6f0-8a48f87317db tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5.e1136a42-3168-47ee-8bdb-1902ec02fd6f {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:38 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5.e1136a42-3168-47ee-8bdb-1902ec02fd6f Jul 17 19:56:38 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4a0057a0-2c5f-48c9-bd94-9371d0f10d92 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4a0057a0-2c5f-48c9-bd94-9371d0f10d92 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:38 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-4a0057a0-2c5f-48c9-bd94-9371d0f10d92 tempest-ProjectMemberTests-1057790160 None] Creating offline snapshot 55eb8563-23f7-4a5f-a505-e19a878694b0 of volume b23060c4-4507-445a-8384-b6dbac521ac2 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:56:38 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b5aa35-e1f1-45e3-9557-80bb88f360d7]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4a0057a0-2c5f-48c9-bd94-9371d0f10d92 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:38 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e1182583-f1e5-4256-a6f0-8a48f87317db tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5.e1136a42-3168-47ee-8bdb-1902ec02fd6f" returned: 0 in 0.269s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:38 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e1182583-f1e5-4256-a6f0-8a48f87317db tempest-ProjectReaderTests-1417432126 None] Lock "cinder-quobyte-e1136a42-3168-47ee-8bdb-1902ec02fd6f" released by "_delete_snapshot" :: held 1.426s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:38 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e1182583-f1e5-4256-a6f0-8a48f87317db tempest-ProjectReaderTests-1417432126 None] Lock "cinder-quobyte-8180ef86-71e4-4e6d-8487-9b8bb1507cb5" released by "delete_snapshot" :: held 1.452s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:38 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2 Jul 17 19:56:38 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:38 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-e1182583-f1e5-4256-a6f0-8a48f87317db tempest-ProjectReaderTests-1417432126 None] Created reservations ['cf5228f0-61c9-4dd1-80d7-0ea3d4a28d63', 'da94018e-418c-45c8-b24f-2716758c30b7', '22998300-719a-4978-a25e-4fffef118ecd', '36f013a1-e22d-4d3a-adcb-bd3b70840b9d'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:56:38 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e1182583-f1e5-4256-a6f0-8a48f87317db tempest-ProjectReaderTests-1417432126 None] Delete snapshot completed successfully. Jul 17 19:56:38 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e1182583-f1e5-4256-a6f0-8a48f87317db tempest-ProjectReaderTests-1417432126 None] Lock "cinder-e1136a42-3168-47ee-8bdb-1902ec02fd6f-delete_snapshot" released by "delete_snapshot" :: held 1.607s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:38 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4a0057a0-2c5f-48c9-bd94-9371d0f10d92 tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2" returned: 0 in 0.357s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:38 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4a0057a0-2c5f-48c9-bd94-9371d0f10d92 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2.55eb8563-23f7-4a5f-a505-e19a878694b0 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:38 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2.55eb8563-23f7-4a5f-a505-e19a878694b0 1G Jul 17 19:56:38 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:39 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4a0057a0-2c5f-48c9-bd94-9371d0f10d92 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2.55eb8563-23f7-4a5f-a505-e19a878694b0 1G" returned: 0 in 0.389s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4a0057a0-2c5f-48c9-bd94-9371d0f10d92 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b23060c4-4507-445a-8384-b6dbac521ac2 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2.55eb8563-23f7-4a5f-a505-e19a878694b0 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:39 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-8873c521-6d23-4068-899d-d9ba38b2cbd0 tempest-ProjectReaderTests-1417432126 None] Acquiring lock "cinder-8180ef86-71e4-4e6d-8487-9b8bb1507cb5-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:39 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b23060c4-4507-445a-8384-b6dbac521ac2 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2.55eb8563-23f7-4a5f-a505-e19a878694b0 Jul 17 19:56:39 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:39 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-8873c521-6d23-4068-899d-d9ba38b2cbd0 tempest-ProjectReaderTests-1417432126 None] Lock "cinder-8180ef86-71e4-4e6d-8487-9b8bb1507cb5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:39 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-8873c521-6d23-4068-899d-d9ba38b2cbd0 tempest-ProjectReaderTests-1417432126 None] Acquiring lock "cinder-quobyte-8180ef86-71e4-4e6d-8487-9b8bb1507cb5" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:39 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-8873c521-6d23-4068-899d-d9ba38b2cbd0 tempest-ProjectReaderTests-1417432126 None] Lock "cinder-quobyte-8180ef86-71e4-4e6d-8487-9b8bb1507cb5" acquired by "delete_volume" :: waited 0.016s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:39 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee1cce9-120f-416c-a1de-1b2b7f2c288a]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8873c521-6d23-4068-899d-d9ba38b2cbd0 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:39 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5 Jul 17 19:56:39 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:39 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4a0057a0-2c5f-48c9-bd94-9371d0f10d92 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b23060c4-4507-445a-8384-b6dbac521ac2 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2.55eb8563-23f7-4a5f-a505-e19a878694b0" returned: 0 in 0.309s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:39 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-4a0057a0-2c5f-48c9-bd94-9371d0f10d92 tempest-ProjectMemberTests-1057790160 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2.55eb8563-23f7-4a5f-a505-e19a878694b0 is being set with open permissions: ugo+rw Jul 17 19:56:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4a0057a0-2c5f-48c9-bd94-9371d0f10d92 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2.55eb8563-23f7-4a5f-a505-e19a878694b0 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:39 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2.55eb8563-23f7-4a5f-a505-e19a878694b0 Jul 17 19:56:39 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:39 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8873c521-6d23-4068-899d-d9ba38b2cbd0 tempest-ProjectReaderTests-1417432126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5" returned: 0 in 0.384s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8873c521-6d23-4068-899d-d9ba38b2cbd0 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:39 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5 Jul 17 19:56:39 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:39 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4a0057a0-2c5f-48c9-bd94-9371d0f10d92 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2.55eb8563-23f7-4a5f-a505-e19a878694b0" returned: 0 in 0.235s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4a0057a0-2c5f-48c9-bd94-9371d0f10d92 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:39 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2.info Jul 17 19:56:39 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:39 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:39 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8873c521-6d23-4068-899d-d9ba38b2cbd0 tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-8180ef86-71e4-4e6d-8487-9b8bb1507cb5" returned: 0 in 0.237s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:40 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-8873c521-6d23-4068-899d-d9ba38b2cbd0 tempest-ProjectReaderTests-1417432126 None] Lock "cinder-quobyte-8180ef86-71e4-4e6d-8487-9b8bb1507cb5" released by "delete_volume" :: held 0.674s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:40 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-8873c521-6d23-4068-899d-d9ba38b2cbd0 tempest-ProjectReaderTests-1417432126 None] Created reservations ['0a17f764-941a-45c2-81c2-666ad485060a', 'dc0b969b-1dfe-425f-8e1d-39111eb24c7c', 'fb98296f-a4da-42d2-847e-934a2c2c3cb3', '0fdda63b-2477-495f-bcf9-fdf64c347525'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:56:40 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4a0057a0-2c5f-48c9-bd94-9371d0f10d92 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2.info" returned: 0 in 0.261s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:40 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-4a0057a0-2c5f-48c9-bd94-9371d0f10d92 tempest-ProjectMemberTests-1057790160 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2.info is being set with open permissions: ugo+rw Jul 17 19:56:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4a0057a0-2c5f-48c9-bd94-9371d0f10d92 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:40 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2.info Jul 17 19:56:40 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8873c521-6d23-4068-899d-d9ba38b2cbd0 tempest-ProjectReaderTests-1417432126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8873c521-6d23-4068-899d-d9ba38b2cbd0 tempest-ProjectReaderTests-1417432126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:40 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8873c521-6d23-4068-899d-d9ba38b2cbd0 tempest-ProjectReaderTests-1417432126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:56:40 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-8873c521-6d23-4068-899d-d9ba38b2cbd0 tempest-ProjectReaderTests-1417432126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:56:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-8873c521-6d23-4068-899d-d9ba38b2cbd0 tempest-ProjectReaderTests-1417432126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8873c521-6d23-4068-899d-d9ba38b2cbd0 tempest-ProjectReaderTests-1417432126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:40 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:56:40 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:40 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4a0057a0-2c5f-48c9-bd94-9371d0f10d92 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2.info" returned: 0 in 0.244s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4a0057a0-2c5f-48c9-bd94-9371d0f10d92 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.883s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:40 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-4a0057a0-2c5f-48c9-bd94-9371d0f10d92 tempest-ProjectMemberTests-1057790160 None] Create snapshot completed successfully Jul 17 19:56:40 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-8873c521-6d23-4068-899d-d9ba38b2cbd0 tempest-ProjectReaderTests-1417432126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.262s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:40 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-8873c521-6d23-4068-899d-d9ba38b2cbd0 tempest-ProjectReaderTests-1417432126 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:56:40 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-8873c521-6d23-4068-899d-d9ba38b2cbd0 tempest-ProjectReaderTests-1417432126 None] Deleted volume successfully. Jul 17 19:56:40 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-8873c521-6d23-4068-899d-d9ba38b2cbd0 tempest-ProjectReaderTests-1417432126 None] Lock "cinder-8180ef86-71e4-4e6d-8487-9b8bb1507cb5-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:40 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-84b29497-5bf1-4579-ba0c-c0907fd5fab2 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-55eb8563-23f7-4a5f-a505-e19a878694b0-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:40 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-84b29497-5bf1-4579-ba0c-c0907fd5fab2 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-55eb8563-23f7-4a5f-a505-e19a878694b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:40 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-84b29497-5bf1-4579-ba0c-c0907fd5fab2 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-quobyte-b23060c4-4507-445a-8384-b6dbac521ac2" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:40 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-84b29497-5bf1-4579-ba0c-c0907fd5fab2 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-b23060c4-4507-445a-8384-b6dbac521ac2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:40 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-84b29497-5bf1-4579-ba0c-c0907fd5fab2 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-quobyte-55eb8563-23f7-4a5f-a505-e19a878694b0" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:40 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-84b29497-5bf1-4579-ba0c-c0907fd5fab2 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-55eb8563-23f7-4a5f-a505-e19a878694b0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:40 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-84b29497-5bf1-4579-ba0c-c0907fd5fab2 tempest-ProjectMemberTests-1057790160 None] Deleting offline snapshot 55eb8563-23f7-4a5f-a505-e19a878694b0 of volume b23060c4-4507-445a-8384-b6dbac521ac2 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:56:40 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-84b29497-5bf1-4579-ba0c-c0907fd5fab2 tempest-ProjectMemberTests-1057790160 None] snapshot_file for this snap is: volume-b23060c4-4507-445a-8384-b6dbac521ac2.55eb8563-23f7-4a5f-a505-e19a878694b0 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:56:40 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c592141-758c-4ee1-9dca-7aea0a05473f]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:40 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-84b29497-5bf1-4579-ba0c-c0907fd5fab2 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2.55eb8563-23f7-4a5f-a505-e19a878694b0 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:40 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2.55eb8563-23f7-4a5f-a505-e19a878694b0 Jul 17 19:56:40 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:41 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-84b29497-5bf1-4579-ba0c-c0907fd5fab2 tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2.55eb8563-23f7-4a5f-a505-e19a878694b0" returned: 0 in 0.355s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:41 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-84b29497-5bf1-4579-ba0c-c0907fd5fab2 tempest-ProjectMemberTests-1057790160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b23060c4-4507-445a-8384-b6dbac521ac2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:56:41 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70fbe61-66ca-4d35-af6e-f7ca67e0172f]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-84b29497-5bf1-4579-ba0c-c0907fd5fab2 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:41 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2 Jul 17 19:56:41 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:41 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-84b29497-5bf1-4579-ba0c-c0907fd5fab2 tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2" returned: 0 in 0.365s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-84b29497-5bf1-4579-ba0c-c0907fd5fab2 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2.55eb8563-23f7-4a5f-a505-e19a878694b0 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:41 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2.55eb8563-23f7-4a5f-a505-e19a878694b0 Jul 17 19:56:41 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:41 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-84b29497-5bf1-4579-ba0c-c0907fd5fab2 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2.55eb8563-23f7-4a5f-a505-e19a878694b0" returned: 0 in 0.372s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-84b29497-5bf1-4579-ba0c-c0907fd5fab2 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2.55eb8563-23f7-4a5f-a505-e19a878694b0 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:41 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2.55eb8563-23f7-4a5f-a505-e19a878694b0 Jul 17 19:56:41 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:42 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-84b29497-5bf1-4579-ba0c-c0907fd5fab2 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2.55eb8563-23f7-4a5f-a505-e19a878694b0" returned: 0 in 0.272s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:42 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-84b29497-5bf1-4579-ba0c-c0907fd5fab2 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-55eb8563-23f7-4a5f-a505-e19a878694b0" released by "_delete_snapshot" :: held 1.473s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:42 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-84b29497-5bf1-4579-ba0c-c0907fd5fab2 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-b23060c4-4507-445a-8384-b6dbac521ac2" released by "delete_snapshot" :: held 1.500s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:42 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-84b29497-5bf1-4579-ba0c-c0907fd5fab2 tempest-ProjectMemberTests-1057790160 None] Created reservations ['0c213de3-a07e-4462-88ee-4e9f63861e3c', 'e992eb3c-aab2-42fe-8bba-ecd5b3fcb1bb', 'c8746d66-ed34-44a2-aafe-de8ba8c503e1', '1341ad74-fb8c-4923-9f31-1ffc7f1a5e8d'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:56:42 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-84b29497-5bf1-4579-ba0c-c0907fd5fab2 tempest-ProjectMemberTests-1057790160 None] Delete snapshot completed successfully. Jul 17 19:56:42 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-84b29497-5bf1-4579-ba0c-c0907fd5fab2 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-55eb8563-23f7-4a5f-a505-e19a878694b0-delete_snapshot" released by "delete_snapshot" :: held 1.638s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:42 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9ef152a2-77a0-4fe9-b96b-fba79ca03ef7 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-b23060c4-4507-445a-8384-b6dbac521ac2-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:42 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9ef152a2-77a0-4fe9-b96b-fba79ca03ef7 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-b23060c4-4507-445a-8384-b6dbac521ac2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:42 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9ef152a2-77a0-4fe9-b96b-fba79ca03ef7 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-quobyte-b23060c4-4507-445a-8384-b6dbac521ac2" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:42 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9ef152a2-77a0-4fe9-b96b-fba79ca03ef7 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-b23060c4-4507-445a-8384-b6dbac521ac2" acquired by "delete_volume" :: waited 0.017s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:42 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc28981-808b-463c-8d68-d4860668bf1d]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9ef152a2-77a0-4fe9-b96b-fba79ca03ef7 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:42 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2 Jul 17 19:56:42 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:43 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9ef152a2-77a0-4fe9-b96b-fba79ca03ef7 tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2" returned: 0 in 0.365s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9ef152a2-77a0-4fe9-b96b-fba79ca03ef7 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:43 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2 Jul 17 19:56:43 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:43 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9ef152a2-77a0-4fe9-b96b-fba79ca03ef7 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b23060c4-4507-445a-8384-b6dbac521ac2" returned: 0 in 0.259s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:43 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9ef152a2-77a0-4fe9-b96b-fba79ca03ef7 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-b23060c4-4507-445a-8384-b6dbac521ac2" released by "delete_volume" :: held 0.685s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:43 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-9ef152a2-77a0-4fe9-b96b-fba79ca03ef7 tempest-ProjectMemberTests-1057790160 None] Created reservations ['c5608b82-9e5c-4940-83a6-f03dcf835713', 'aeda5b71-a78d-454a-8a00-f06e4d4c1f60', 'fc2fb0ae-12fb-4a54-a85e-944e0a818f0f', '95796bee-f63c-4192-8900-7d66309abfa8'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:56:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9ef152a2-77a0-4fe9-b96b-fba79ca03ef7 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9ef152a2-77a0-4fe9-b96b-fba79ca03ef7 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:43 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9ef152a2-77a0-4fe9-b96b-fba79ca03ef7 tempest-ProjectMemberTests-1057790160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:56:43 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-9ef152a2-77a0-4fe9-b96b-fba79ca03ef7 tempest-ProjectMemberTests-1057790160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:56:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-9ef152a2-77a0-4fe9-b96b-fba79ca03ef7 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9ef152a2-77a0-4fe9-b96b-fba79ca03ef7 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:43 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:56:43 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:43 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-9ef152a2-77a0-4fe9-b96b-fba79ca03ef7 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.265s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:43 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-9ef152a2-77a0-4fe9-b96b-fba79ca03ef7 tempest-ProjectMemberTests-1057790160 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:56:43 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-9ef152a2-77a0-4fe9-b96b-fba79ca03ef7 tempest-ProjectMemberTests-1057790160 None] Deleted volume successfully. Jul 17 19:56:43 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-9ef152a2-77a0-4fe9-b96b-fba79ca03ef7 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-b23060c4-4507-445a-8384-b6dbac521ac2-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:44 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:56:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] Flow 'volume_create_manager' (14ec0be2-85df-4123-a440-e347493178ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:56:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4c15af6-ac7a-4348-a547-37e13a102a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4c15af6-ac7a-4348-a547-37e13a102a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-677221948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f0df2e-7977-4ba6-a5f6-364f4d0eff25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='292c7664e8d0464b8d760da18a48ef96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:56:44Z,use_quota=True,user_id='2116daf9106f417f838ea1e496129378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a7cc0b-6c71-4e94-9235-12f2352e5900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a7cc0b-6c71-4e94-9235-12f2352e5900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc39b8c1-7e60-40b6-99a8-1d37828f0fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc39b8c1-7e60-40b6-99a8-1d37828f0fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9f0df2e-7977-4ba6-a5f6-364f4d0eff25', 'volume_name': 'volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be8b122-0be3-4294-83b9-431a73a6cf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be8b122-0be3-4294-83b9-431a73a6cf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:44 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c20e84b9-54a0-4ef6-9da4-6a607ce19afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:44 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] Volume c9f0df2e-7977-4ba6-a5f6-364f4d0eff25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25', 'volume_size': 1} Jul 17 19:56:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-677221948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f0df2e-7977-4ba6-a5f6-364f4d0eff25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='292c7664e8d0464b8d760da18a48ef96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:56:44Z,use_quota=True,user_id='2116daf9106f417f838ea1e496129378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:56:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] Creating volume c9f0df2e-7977-4ba6-a5f6-364f4d0eff25 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:56:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:56:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:56:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:44 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:56:44 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:56:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:44 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25 1073741824 Jul 17 19:56:44 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:44 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25 1073741824" returned: 0 in 0.442s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:44 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25 Jul 17 19:56:44 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:45 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25" returned: 0 in 0.254s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:45 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:56:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c20e84b9-54a0-4ef6-9da4-6a607ce19afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1704e36e-a2e3-4ebd-851f-f2f38308df17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:45 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] Volume volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25 (c9f0df2e-7977-4ba6-a5f6-364f4d0eff25): created successfully Jul 17 19:56:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1704e36e-a2e3-4ebd-851f-f2f38308df17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:45 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] Flow 'volume_create_manager' (14ec0be2-85df-4123-a440-e347493178ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:56:45 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-39b062b6-52e4-4781-a728-0106efeebcc7 tempest-ProjectMemberTests-1057790160 None] Created volume successfully. Jul 17 19:56:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c3e83dcc-ef7b-4764-863a-41fc42e4eb94 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c3e83dcc-ef7b-4764-863a-41fc42e4eb94 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:45 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-c3e83dcc-ef7b-4764-863a-41fc42e4eb94 tempest-ProjectMemberTests-1057790160 None] Creating offline snapshot cef76a44-b793-4859-8fc0-f75d8bc4de6d of volume c9f0df2e-7977-4ba6-a5f6-364f4d0eff25 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:56:45 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[546b99cc-faae-4bc4-86f8-08616e3795ec]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c3e83dcc-ef7b-4764-863a-41fc42e4eb94 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:45 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25 Jul 17 19:56:45 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:45 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c3e83dcc-ef7b-4764-863a-41fc42e4eb94 tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25" returned: 0 in 0.345s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c3e83dcc-ef7b-4764-863a-41fc42e4eb94 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25.cef76a44-b793-4859-8fc0-f75d8bc4de6d 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:45 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25.cef76a44-b793-4859-8fc0-f75d8bc4de6d 1G Jul 17 19:56:45 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:46 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c3e83dcc-ef7b-4764-863a-41fc42e4eb94 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25.cef76a44-b793-4859-8fc0-f75d8bc4de6d 1G" returned: 0 in 0.387s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c3e83dcc-ef7b-4764-863a-41fc42e4eb94 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25.cef76a44-b793-4859-8fc0-f75d8bc4de6d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:46 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25.cef76a44-b793-4859-8fc0-f75d8bc4de6d Jul 17 19:56:46 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:46 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c3e83dcc-ef7b-4764-863a-41fc42e4eb94 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25.cef76a44-b793-4859-8fc0-f75d8bc4de6d" returned: 0 in 0.308s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:46 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-c3e83dcc-ef7b-4764-863a-41fc42e4eb94 tempest-ProjectMemberTests-1057790160 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25.cef76a44-b793-4859-8fc0-f75d8bc4de6d is being set with open permissions: ugo+rw Jul 17 19:56:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c3e83dcc-ef7b-4764-863a-41fc42e4eb94 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25.cef76a44-b793-4859-8fc0-f75d8bc4de6d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:46 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25.cef76a44-b793-4859-8fc0-f75d8bc4de6d Jul 17 19:56:46 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:46 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c3e83dcc-ef7b-4764-863a-41fc42e4eb94 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25.cef76a44-b793-4859-8fc0-f75d8bc4de6d" returned: 0 in 0.250s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c3e83dcc-ef7b-4764-863a-41fc42e4eb94 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:46 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25.info Jul 17 19:56:46 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:47 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c3e83dcc-ef7b-4764-863a-41fc42e4eb94 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25.info" returned: 0 in 0.253s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:47 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-c3e83dcc-ef7b-4764-863a-41fc42e4eb94 tempest-ProjectMemberTests-1057790160 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25.info is being set with open permissions: ugo+rw Jul 17 19:56:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c3e83dcc-ef7b-4764-863a-41fc42e4eb94 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:47 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25.info Jul 17 19:56:47 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:47 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c3e83dcc-ef7b-4764-863a-41fc42e4eb94 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25.info" returned: 0 in 0.243s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c3e83dcc-ef7b-4764-863a-41fc42e4eb94 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.865s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:47 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-c3e83dcc-ef7b-4764-863a-41fc42e4eb94 tempest-ProjectMemberTests-1057790160 None] Create snapshot completed successfully Jul 17 19:56:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-17d805fb-75ea-4508-9c0d-c1a8420ce6d8 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-cef76a44-b793-4859-8fc0-f75d8bc4de6d-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-17d805fb-75ea-4508-9c0d-c1a8420ce6d8 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-cef76a44-b793-4859-8fc0-f75d8bc4de6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-17d805fb-75ea-4508-9c0d-c1a8420ce6d8 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-quobyte-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-17d805fb-75ea-4508-9c0d-c1a8420ce6d8 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-17d805fb-75ea-4508-9c0d-c1a8420ce6d8 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-quobyte-cef76a44-b793-4859-8fc0-f75d8bc4de6d" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-17d805fb-75ea-4508-9c0d-c1a8420ce6d8 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-cef76a44-b793-4859-8fc0-f75d8bc4de6d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:47 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-17d805fb-75ea-4508-9c0d-c1a8420ce6d8 tempest-ProjectMemberTests-1057790160 None] Deleting offline snapshot cef76a44-b793-4859-8fc0-f75d8bc4de6d of volume c9f0df2e-7977-4ba6-a5f6-364f4d0eff25 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:56:47 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-17d805fb-75ea-4508-9c0d-c1a8420ce6d8 tempest-ProjectMemberTests-1057790160 None] snapshot_file for this snap is: volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25.cef76a44-b793-4859-8fc0-f75d8bc4de6d {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:56:47 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ab6dc3-6c24-4340-bc22-ec00768d6b86]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-17d805fb-75ea-4508-9c0d-c1a8420ce6d8 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25.cef76a44-b793-4859-8fc0-f75d8bc4de6d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:47 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25.cef76a44-b793-4859-8fc0-f75d8bc4de6d Jul 17 19:56:47 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:48 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-17d805fb-75ea-4508-9c0d-c1a8420ce6d8 tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25.cef76a44-b793-4859-8fc0-f75d8bc4de6d" returned: 0 in 0.346s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:48 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-17d805fb-75ea-4508-9c0d-c1a8420ce6d8 tempest-ProjectMemberTests-1057790160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:56:48 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[48961f95-d268-4931-a61f-b9e9cc7caa50]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-17d805fb-75ea-4508-9c0d-c1a8420ce6d8 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:48 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25 Jul 17 19:56:48 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:48 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-17d805fb-75ea-4508-9c0d-c1a8420ce6d8 tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25" returned: 0 in 0.353s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-17d805fb-75ea-4508-9c0d-c1a8420ce6d8 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25.cef76a44-b793-4859-8fc0-f75d8bc4de6d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:48 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25.cef76a44-b793-4859-8fc0-f75d8bc4de6d Jul 17 19:56:48 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:48 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-17d805fb-75ea-4508-9c0d-c1a8420ce6d8 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25.cef76a44-b793-4859-8fc0-f75d8bc4de6d" returned: 0 in 0.367s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:48 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-17d805fb-75ea-4508-9c0d-c1a8420ce6d8 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25.cef76a44-b793-4859-8fc0-f75d8bc4de6d {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:48 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25.cef76a44-b793-4859-8fc0-f75d8bc4de6d Jul 17 19:56:48 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:49 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-17d805fb-75ea-4508-9c0d-c1a8420ce6d8 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25.cef76a44-b793-4859-8fc0-f75d8bc4de6d" returned: 0 in 0.254s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-17d805fb-75ea-4508-9c0d-c1a8420ce6d8 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-cef76a44-b793-4859-8fc0-f75d8bc4de6d" released by "_delete_snapshot" :: held 1.406s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-17d805fb-75ea-4508-9c0d-c1a8420ce6d8 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25" released by "delete_snapshot" :: held 1.430s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:49 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=214,cinder:UPDATE=251,cinder:DELETE=21,cinder:INSERT=64 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:56:49 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:UPDATE=265,cinder:INSERT=75,cinder:SELECT=185,cinder:DELETE=23 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:56:49 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-17d805fb-75ea-4508-9c0d-c1a8420ce6d8 tempest-ProjectMemberTests-1057790160 None] Created reservations ['34cb3bcd-b9f5-43ec-bbd0-40dd2dc2d865', 'decd8a81-d726-4742-aa97-6d8cb11166f8', '1587b56d-1556-4160-a594-ad76db3c6894', '91e12d62-7095-4771-bbd4-a23d6d9efb92'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:56:49 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-17d805fb-75ea-4508-9c0d-c1a8420ce6d8 tempest-ProjectMemberTests-1057790160 None] Delete snapshot completed successfully. Jul 17 19:56:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-17d805fb-75ea-4508-9c0d-c1a8420ce6d8 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-cef76a44-b793-4859-8fc0-f75d8bc4de6d-delete_snapshot" released by "delete_snapshot" :: held 1.579s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e3aecd60-b067-414c-917f-d090947f8d36 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e3aecd60-b067-414c-917f-d090947f8d36 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e3aecd60-b067-414c-917f-d090947f8d36 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-quobyte-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:49 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e3aecd60-b067-414c-917f-d090947f8d36 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25" acquired by "delete_volume" :: waited 0.019s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:49 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57c4eda-1773-4e27-94ea-eb12ecbbe76a]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:49 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3aecd60-b067-414c-917f-d090947f8d36 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:50 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25 Jul 17 19:56:50 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:50 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3aecd60-b067-414c-917f-d090947f8d36 tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25" returned: 0 in 0.373s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3aecd60-b067-414c-917f-d090947f8d36 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:50 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25 Jul 17 19:56:50 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:50 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3aecd60-b067-414c-917f-d090947f8d36 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25" returned: 0 in 0.263s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:50 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e3aecd60-b067-414c-917f-d090947f8d36 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25" released by "delete_volume" :: held 0.692s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:50 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-e3aecd60-b067-414c-917f-d090947f8d36 tempest-ProjectMemberTests-1057790160 None] Created reservations ['7dcde664-0874-4ebe-9863-bce6e5da8f2f', '3db3bc69-fdb2-447b-a714-1e6d0b502210', '9993c5b1-ecc3-462c-b4b6-e62b12a27683', 'd6f89065-79da-41a0-bd4c-f8653b94e619'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:56:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e3aecd60-b067-414c-917f-d090947f8d36 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e3aecd60-b067-414c-917f-d090947f8d36 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:50 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e3aecd60-b067-414c-917f-d090947f8d36 tempest-ProjectMemberTests-1057790160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:56:50 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-e3aecd60-b067-414c-917f-d090947f8d36 tempest-ProjectMemberTests-1057790160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:56:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-e3aecd60-b067-414c-917f-d090947f8d36 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:50 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3aecd60-b067-414c-917f-d090947f8d36 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:50 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:56:50 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:51 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-e3aecd60-b067-414c-917f-d090947f8d36 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.281s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:51 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-e3aecd60-b067-414c-917f-d090947f8d36 tempest-ProjectMemberTests-1057790160 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:56:51 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-e3aecd60-b067-414c-917f-d090947f8d36 tempest-ProjectMemberTests-1057790160 None] Deleted volume successfully. Jul 17 19:56:51 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-e3aecd60-b067-414c-917f-d090947f8d36 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-c9f0df2e-7977-4ba6-a5f6-364f4d0eff25-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:51 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:56:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] Flow 'volume_create_manager' (69e0c332-1480-4071-b18e-16f8356cd9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:56:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (316e383f-2a3d-4464-a68c-775d38675e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (316e383f-2a3d-4464-a68c-775d38675e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1560840502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5debe06-b3e1-403e-8638-bbda170d4003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='292c7664e8d0464b8d760da18a48ef96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:56:51Z,use_quota=True,user_id='2116daf9106f417f838ea1e496129378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dd51fbd-5431-4958-a854-643edfd0b481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dd51fbd-5431-4958-a854-643edfd0b481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e34ceb-fd76-4421-9d18-e2f591a751eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e34ceb-fd76-4421-9d18-e2f591a751eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5debe06-b3e1-403e-8638-bbda170d4003', 'volume_name': 'volume-b5debe06-b3e1-403e-8638-bbda170d4003', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07303b87-f729-4de6-8810-72e28a77fcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07303b87-f729-4de6-8810-72e28a77fcbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:51 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67807b3c-cb5f-4086-9def-48eaff350825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:51 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] Volume b5debe06-b3e1-403e-8638-bbda170d4003: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5debe06-b3e1-403e-8638-bbda170d4003', 'volume_size': 1} Jul 17 19:56:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:51 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1560840502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5debe06-b3e1-403e-8638-bbda170d4003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='292c7664e8d0464b8d760da18a48ef96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:56:51Z,use_quota=True,user_id='2116daf9106f417f838ea1e496129378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:56:51 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] Creating volume b5debe06-b3e1-403e-8638-bbda170d4003 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:56:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:51 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:56:51 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:56:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:51 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:56:51 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:56:51 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:51 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003 1073741824 Jul 17 19:56:51 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:52 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003 1073741824" returned: 0 in 0.468s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:52 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003 Jul 17 19:56:52 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:52 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003" returned: 0 in 0.252s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:52 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:56:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67807b3c-cb5f-4086-9def-48eaff350825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5debe06-b3e1-403e-8638-bbda170d4003', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d4e158b-a494-4111-81ba-b2819cac0ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:52 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] Volume volume-b5debe06-b3e1-403e-8638-bbda170d4003 (b5debe06-b3e1-403e-8638-bbda170d4003): created successfully Jul 17 19:56:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d4e158b-a494-4111-81ba-b2819cac0ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:52 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] Flow 'volume_create_manager' (69e0c332-1480-4071-b18e-16f8356cd9e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:56:52 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-0983b4a6-342b-478b-8b96-8f7b03e0a498 tempest-ProjectMemberTests-1057790160 None] Created volume successfully. Jul 17 19:56:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4a7131eb-7c5e-480a-aef8-9f6328071cea tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4a7131eb-7c5e-480a-aef8-9f6328071cea tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:52 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-4a7131eb-7c5e-480a-aef8-9f6328071cea tempest-ProjectMemberTests-1057790160 None] Creating offline snapshot b4a77375-a296-40ac-a2cc-3bf8362cc625 of volume b5debe06-b3e1-403e-8638-bbda170d4003 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:56:52 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80363c2-9f45-4a2c-b394-a876359eab71]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:52 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4a7131eb-7c5e-480a-aef8-9f6328071cea tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:52 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003 Jul 17 19:56:52 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:53 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4a7131eb-7c5e-480a-aef8-9f6328071cea tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003" returned: 0 in 0.363s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4a7131eb-7c5e-480a-aef8-9f6328071cea tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003.b4a77375-a296-40ac-a2cc-3bf8362cc625 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:53 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003.b4a77375-a296-40ac-a2cc-3bf8362cc625 1G Jul 17 19:56:53 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:53 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4a7131eb-7c5e-480a-aef8-9f6328071cea tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003.b4a77375-a296-40ac-a2cc-3bf8362cc625 1G" returned: 0 in 0.404s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4a7131eb-7c5e-480a-aef8-9f6328071cea tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5debe06-b3e1-403e-8638-bbda170d4003 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003.b4a77375-a296-40ac-a2cc-3bf8362cc625 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:53 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5debe06-b3e1-403e-8638-bbda170d4003 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003.b4a77375-a296-40ac-a2cc-3bf8362cc625 Jul 17 19:56:53 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:53 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4a7131eb-7c5e-480a-aef8-9f6328071cea tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5debe06-b3e1-403e-8638-bbda170d4003 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003.b4a77375-a296-40ac-a2cc-3bf8362cc625" returned: 0 in 0.321s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:53 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-4a7131eb-7c5e-480a-aef8-9f6328071cea tempest-ProjectMemberTests-1057790160 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003.b4a77375-a296-40ac-a2cc-3bf8362cc625 is being set with open permissions: ugo+rw Jul 17 19:56:53 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4a7131eb-7c5e-480a-aef8-9f6328071cea tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003.b4a77375-a296-40ac-a2cc-3bf8362cc625 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:53 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003.b4a77375-a296-40ac-a2cc-3bf8362cc625 Jul 17 19:56:53 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:54 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4a7131eb-7c5e-480a-aef8-9f6328071cea tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003.b4a77375-a296-40ac-a2cc-3bf8362cc625" returned: 0 in 0.255s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4a7131eb-7c5e-480a-aef8-9f6328071cea tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:54 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003.info Jul 17 19:56:54 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:54 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4a7131eb-7c5e-480a-aef8-9f6328071cea tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003.info" returned: 0 in 0.263s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:54 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-4a7131eb-7c5e-480a-aef8-9f6328071cea tempest-ProjectMemberTests-1057790160 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003.info is being set with open permissions: ugo+rw Jul 17 19:56:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4a7131eb-7c5e-480a-aef8-9f6328071cea tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:54 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003.info Jul 17 19:56:54 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:54 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4a7131eb-7c5e-480a-aef8-9f6328071cea tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003.info" returned: 0 in 0.258s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4a7131eb-7c5e-480a-aef8-9f6328071cea tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.948s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:54 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-4a7131eb-7c5e-480a-aef8-9f6328071cea tempest-ProjectMemberTests-1057790160 None] Create snapshot completed successfully Jul 17 19:56:54 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-efdde5e8-8e77-497e-8172-3c45b71e8384 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-b4a77375-a296-40ac-a2cc-3bf8362cc625-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:54 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-efdde5e8-8e77-497e-8172-3c45b71e8384 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-b4a77375-a296-40ac-a2cc-3bf8362cc625-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:54 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-efdde5e8-8e77-497e-8172-3c45b71e8384 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-quobyte-b5debe06-b3e1-403e-8638-bbda170d4003" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:54 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-efdde5e8-8e77-497e-8172-3c45b71e8384 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-b5debe06-b3e1-403e-8638-bbda170d4003" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:54 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-efdde5e8-8e77-497e-8172-3c45b71e8384 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-quobyte-b4a77375-a296-40ac-a2cc-3bf8362cc625" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:54 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-efdde5e8-8e77-497e-8172-3c45b71e8384 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-b4a77375-a296-40ac-a2cc-3bf8362cc625" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:54 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-efdde5e8-8e77-497e-8172-3c45b71e8384 tempest-ProjectMemberTests-1057790160 None] Deleting offline snapshot b4a77375-a296-40ac-a2cc-3bf8362cc625 of volume b5debe06-b3e1-403e-8638-bbda170d4003 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:56:54 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-efdde5e8-8e77-497e-8172-3c45b71e8384 tempest-ProjectMemberTests-1057790160 None] snapshot_file for this snap is: volume-b5debe06-b3e1-403e-8638-bbda170d4003.b4a77375-a296-40ac-a2cc-3bf8362cc625 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:56:54 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[9987fae9-1610-4540-8c0e-5d56678bcb5b]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:54 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-efdde5e8-8e77-497e-8172-3c45b71e8384 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003.b4a77375-a296-40ac-a2cc-3bf8362cc625 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:54 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003.b4a77375-a296-40ac-a2cc-3bf8362cc625 Jul 17 19:56:54 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:55 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-efdde5e8-8e77-497e-8172-3c45b71e8384 tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003.b4a77375-a296-40ac-a2cc-3bf8362cc625" returned: 0 in 0.372s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:55 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-efdde5e8-8e77-497e-8172-3c45b71e8384 tempest-ProjectMemberTests-1057790160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5debe06-b3e1-403e-8638-bbda170d4003(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:56:55 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b1701d-9912-4281-9b79-c8de6fc8b85f]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-efdde5e8-8e77-497e-8172-3c45b71e8384 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:55 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003 Jul 17 19:56:55 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:55 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-efdde5e8-8e77-497e-8172-3c45b71e8384 tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003" returned: 0 in 0.359s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-efdde5e8-8e77-497e-8172-3c45b71e8384 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003.b4a77375-a296-40ac-a2cc-3bf8362cc625 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:55 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003.b4a77375-a296-40ac-a2cc-3bf8362cc625 Jul 17 19:56:55 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:55 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-efdde5e8-8e77-497e-8172-3c45b71e8384 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003.b4a77375-a296-40ac-a2cc-3bf8362cc625" returned: 0 in 0.348s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:55 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-efdde5e8-8e77-497e-8172-3c45b71e8384 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003.b4a77375-a296-40ac-a2cc-3bf8362cc625 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:56 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003.b4a77375-a296-40ac-a2cc-3bf8362cc625 Jul 17 19:56:56 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:56 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:56 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-efdde5e8-8e77-497e-8172-3c45b71e8384 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003.b4a77375-a296-40ac-a2cc-3bf8362cc625" returned: 0 in 0.243s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:56 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-efdde5e8-8e77-497e-8172-3c45b71e8384 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-b4a77375-a296-40ac-a2cc-3bf8362cc625" released by "_delete_snapshot" :: held 1.412s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:56 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-efdde5e8-8e77-497e-8172-3c45b71e8384 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-b5debe06-b3e1-403e-8638-bbda170d4003" released by "delete_snapshot" :: held 1.433s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:56 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-efdde5e8-8e77-497e-8172-3c45b71e8384 tempest-ProjectMemberTests-1057790160 None] Created reservations ['4c2d9c76-acb1-4b7c-a38d-82c9563968b4', 'b6dcaa1c-f50d-4f14-b241-530d0f292f48', '0635c9b4-1fcd-4eb9-b4d6-aa5cfd1a1bf7', 'bd537cf0-efde-47b9-9a48-68383317fda3'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:56:56 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-efdde5e8-8e77-497e-8172-3c45b71e8384 tempest-ProjectMemberTests-1057790160 None] Delete snapshot completed successfully. Jul 17 19:56:56 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-efdde5e8-8e77-497e-8172-3c45b71e8384 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-b4a77375-a296-40ac-a2cc-3bf8362cc625-delete_snapshot" released by "delete_snapshot" :: held 1.589s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:56 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-749948a6-ddaa-4bc0-8e59-9600190a0c9f tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-b5debe06-b3e1-403e-8638-bbda170d4003-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:56 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-749948a6-ddaa-4bc0-8e59-9600190a0c9f tempest-ProjectMemberTests-1057790160 None] Lock "cinder-b5debe06-b3e1-403e-8638-bbda170d4003-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:57 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-749948a6-ddaa-4bc0-8e59-9600190a0c9f tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-quobyte-b5debe06-b3e1-403e-8638-bbda170d4003" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:56:57 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-749948a6-ddaa-4bc0-8e59-9600190a0c9f tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-b5debe06-b3e1-403e-8638-bbda170d4003" acquired by "delete_volume" :: waited 0.013s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:56:57 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e08c3b-a806-4486-b814-aeb41591e638]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-749948a6-ddaa-4bc0-8e59-9600190a0c9f tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:57 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003 Jul 17 19:56:57 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:57 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-749948a6-ddaa-4bc0-8e59-9600190a0c9f tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003" returned: 0 in 0.346s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-749948a6-ddaa-4bc0-8e59-9600190a0c9f tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:57 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003 Jul 17 19:56:57 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:57 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-749948a6-ddaa-4bc0-8e59-9600190a0c9f tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-b5debe06-b3e1-403e-8638-bbda170d4003" returned: 0 in 0.236s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:57 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-749948a6-ddaa-4bc0-8e59-9600190a0c9f tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-b5debe06-b3e1-403e-8638-bbda170d4003" released by "delete_volume" :: held 0.636s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:57 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-749948a6-ddaa-4bc0-8e59-9600190a0c9f tempest-ProjectMemberTests-1057790160 None] Created reservations ['d9f7f851-9cc6-4f2c-b1b6-03afc4eafcf7', 'c4658462-2cef-4cb9-87f9-ff3a1363c829', '7e3a731e-b3c6-41ff-98d8-dcab541c84d0', '7eb23307-308a-4863-97d6-814af73abeaf'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:56:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-749948a6-ddaa-4bc0-8e59-9600190a0c9f tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-749948a6-ddaa-4bc0-8e59-9600190a0c9f tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:57 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-749948a6-ddaa-4bc0-8e59-9600190a0c9f tempest-ProjectMemberTests-1057790160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:56:57 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-749948a6-ddaa-4bc0-8e59-9600190a0c9f tempest-ProjectMemberTests-1057790160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:56:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-749948a6-ddaa-4bc0-8e59-9600190a0c9f tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-749948a6-ddaa-4bc0-8e59-9600190a0c9f tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:57 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:56:57 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:57 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:57 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-749948a6-ddaa-4bc0-8e59-9600190a0c9f tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.231s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:57 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-749948a6-ddaa-4bc0-8e59-9600190a0c9f tempest-ProjectMemberTests-1057790160 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:56:58 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-749948a6-ddaa-4bc0-8e59-9600190a0c9f tempest-ProjectMemberTests-1057790160 None] Deleted volume successfully. Jul 17 19:56:58 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-749948a6-ddaa-4bc0-8e59-9600190a0c9f tempest-ProjectMemberTests-1057790160 None] Lock "cinder-b5debe06-b3e1-403e-8638-bbda170d4003-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:56:58 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:56:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] Flow 'volume_create_manager' (a0088b0b-aafa-4584-bac0-643b003181ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:56:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe242e3-b240-435a-8cc4-042b9be6bf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe242e3-b240-435a-8cc4-042b9be6bf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-169398312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f79854f-bb6c-4203-822e-4a053d6c713b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='292c7664e8d0464b8d760da18a48ef96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:56:58Z,use_quota=True,user_id='2116daf9106f417f838ea1e496129378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41353db-a1ef-43eb-9c4b-2bf268d09105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41353db-a1ef-43eb-9c4b-2bf268d09105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69fbde5c-7618-443d-aace-85148767adcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69fbde5c-7618-443d-aace-85148767adcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f79854f-bb6c-4203-822e-4a053d6c713b', 'volume_name': 'volume-5f79854f-bb6c-4203-822e-4a053d6c713b', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91897ad9-8802-493b-806c-4c86181adf60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91897ad9-8802-493b-806c-4c86181adf60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:58 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05ca571f-3252-41e2-9091-8554de73c531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:58 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] Volume 5f79854f-bb6c-4203-822e-4a053d6c713b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f79854f-bb6c-4203-822e-4a053d6c713b', 'volume_size': 1} Jul 17 19:56:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-169398312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f79854f-bb6c-4203-822e-4a053d6c713b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='292c7664e8d0464b8d760da18a48ef96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:56:58Z,use_quota=True,user_id='2116daf9106f417f838ea1e496129378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:56:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] Creating volume 5f79854f-bb6c-4203-822e-4a053d6c713b {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:56:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:56:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:56:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:58 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:56:58 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:56:58 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:58 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b 1073741824 Jul 17 19:56:58 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:59 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b 1073741824" returned: 0 in 0.391s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:59 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b Jul 17 19:56:59 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:56:59 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Jul 17 19:56:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b" returned: 0 in 0.236s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:56:59 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] <== create_volume: return (665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:56:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.667s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:56:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05ca571f-3252-41e2-9091-8554de73c531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f79854f-bb6c-4203-822e-4a053d6c713b', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba653de5-09a0-44fe-88bf-f1bb6d60769c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:56:59 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] Volume volume-5f79854f-bb6c-4203-822e-4a053d6c713b (5f79854f-bb6c-4203-822e-4a053d6c713b): created successfully Jul 17 19:56:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba653de5-09a0-44fe-88bf-f1bb6d60769c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:56:59 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] Flow 'volume_create_manager' (a0088b0b-aafa-4584-bac0-643b003181ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:56:59 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-27ada45b-e8f0-4ed7-8166-9200cab2c98d tempest-ProjectMemberTests-1057790160 None] Created volume successfully. Jul 17 19:56:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ba2bce6d-1861-4ca1-81ff-9773aa868993 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:56:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ba2bce6d-1861-4ca1-81ff-9773aa868993 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:56:59 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-ba2bce6d-1861-4ca1-81ff-9773aa868993 tempest-ProjectMemberTests-1057790160 None] Creating offline snapshot a5b28e5b-2a1b-4732-a6a6-19ac356c17d7 of volume 5f79854f-bb6c-4203-822e-4a053d6c713b {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:56:59 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8573d6-1f58-499b-9f2f-36892e3f1644]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:56:59 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ba2bce6d-1861-4ca1-81ff-9773aa868993 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:56:59 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b Jul 17 19:56:59 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:00 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ba2bce6d-1861-4ca1-81ff-9773aa868993 tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b" returned: 0 in 0.335s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ba2bce6d-1861-4ca1-81ff-9773aa868993 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b.a5b28e5b-2a1b-4732-a6a6-19ac356c17d7 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:00 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b.a5b28e5b-2a1b-4732-a6a6-19ac356c17d7 1G Jul 17 19:57:00 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:00 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ba2bce6d-1861-4ca1-81ff-9773aa868993 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b.a5b28e5b-2a1b-4732-a6a6-19ac356c17d7 1G" returned: 0 in 0.377s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ba2bce6d-1861-4ca1-81ff-9773aa868993 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f79854f-bb6c-4203-822e-4a053d6c713b -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b.a5b28e5b-2a1b-4732-a6a6-19ac356c17d7 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:00 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f79854f-bb6c-4203-822e-4a053d6c713b -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b.a5b28e5b-2a1b-4732-a6a6-19ac356c17d7 Jul 17 19:57:00 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:00 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ba2bce6d-1861-4ca1-81ff-9773aa868993 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f79854f-bb6c-4203-822e-4a053d6c713b -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b.a5b28e5b-2a1b-4732-a6a6-19ac356c17d7" returned: 0 in 0.275s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:00 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-ba2bce6d-1861-4ca1-81ff-9773aa868993 tempest-ProjectMemberTests-1057790160 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b.a5b28e5b-2a1b-4732-a6a6-19ac356c17d7 is being set with open permissions: ugo+rw Jul 17 19:57:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ba2bce6d-1861-4ca1-81ff-9773aa868993 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b.a5b28e5b-2a1b-4732-a6a6-19ac356c17d7 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:00 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b.a5b28e5b-2a1b-4732-a6a6-19ac356c17d7 Jul 17 19:57:00 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:00 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ba2bce6d-1861-4ca1-81ff-9773aa868993 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b.a5b28e5b-2a1b-4732-a6a6-19ac356c17d7" returned: 0 in 0.234s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:00 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ba2bce6d-1861-4ca1-81ff-9773aa868993 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:00 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b.info Jul 17 19:57:00 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:01 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ba2bce6d-1861-4ca1-81ff-9773aa868993 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b.info" returned: 0 in 0.242s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:01 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-ba2bce6d-1861-4ca1-81ff-9773aa868993 tempest-ProjectMemberTests-1057790160 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b.info is being set with open permissions: ugo+rw Jul 17 19:57:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ba2bce6d-1861-4ca1-81ff-9773aa868993 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:01 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b.info Jul 17 19:57:01 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:01 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-ba2bce6d-1861-4ca1-81ff-9773aa868993 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b.info" returned: 0 in 0.239s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-ba2bce6d-1861-4ca1-81ff-9773aa868993 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.780s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:57:01 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-ba2bce6d-1861-4ca1-81ff-9773aa868993 tempest-ProjectMemberTests-1057790160 None] Create snapshot completed successfully Jul 17 19:57:01 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-bc6d364d-ba0f-4654-ae84-f9fce9d8cb9c tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-a5b28e5b-2a1b-4732-a6a6-19ac356c17d7-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:57:01 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-bc6d364d-ba0f-4654-ae84-f9fce9d8cb9c tempest-ProjectMemberTests-1057790160 None] Lock "cinder-a5b28e5b-2a1b-4732-a6a6-19ac356c17d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:57:01 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-bc6d364d-ba0f-4654-ae84-f9fce9d8cb9c tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-quobyte-5f79854f-bb6c-4203-822e-4a053d6c713b" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:57:01 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-bc6d364d-ba0f-4654-ae84-f9fce9d8cb9c tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-5f79854f-bb6c-4203-822e-4a053d6c713b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:57:01 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-bc6d364d-ba0f-4654-ae84-f9fce9d8cb9c tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-quobyte-a5b28e5b-2a1b-4732-a6a6-19ac356c17d7" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:57:01 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-bc6d364d-ba0f-4654-ae84-f9fce9d8cb9c tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-a5b28e5b-2a1b-4732-a6a6-19ac356c17d7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:57:01 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-bc6d364d-ba0f-4654-ae84-f9fce9d8cb9c tempest-ProjectMemberTests-1057790160 None] Deleting offline snapshot a5b28e5b-2a1b-4732-a6a6-19ac356c17d7 of volume 5f79854f-bb6c-4203-822e-4a053d6c713b {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:57:01 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-bc6d364d-ba0f-4654-ae84-f9fce9d8cb9c tempest-ProjectMemberTests-1057790160 None] snapshot_file for this snap is: volume-5f79854f-bb6c-4203-822e-4a053d6c713b.a5b28e5b-2a1b-4732-a6a6-19ac356c17d7 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:57:01 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a0e818-9c77-468a-894e-050a43cfe6e0]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:57:01 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bc6d364d-ba0f-4654-ae84-f9fce9d8cb9c tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b.a5b28e5b-2a1b-4732-a6a6-19ac356c17d7 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:02 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b.a5b28e5b-2a1b-4732-a6a6-19ac356c17d7 Jul 17 19:57:02 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:02 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bc6d364d-ba0f-4654-ae84-f9fce9d8cb9c tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b.a5b28e5b-2a1b-4732-a6a6-19ac356c17d7" returned: 0 in 0.346s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:02 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-bc6d364d-ba0f-4654-ae84-f9fce9d8cb9c tempest-ProjectMemberTests-1057790160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f79854f-bb6c-4203-822e-4a053d6c713b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:57:02 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbb1974-ffc3-44e0-b49c-b165c17d4423]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:57:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bc6d364d-ba0f-4654-ae84-f9fce9d8cb9c tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:02 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b Jul 17 19:57:02 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:02 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bc6d364d-ba0f-4654-ae84-f9fce9d8cb9c tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b" returned: 0 in 0.344s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bc6d364d-ba0f-4654-ae84-f9fce9d8cb9c tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b.a5b28e5b-2a1b-4732-a6a6-19ac356c17d7 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:02 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b.a5b28e5b-2a1b-4732-a6a6-19ac356c17d7 Jul 17 19:57:02 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:02 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bc6d364d-ba0f-4654-ae84-f9fce9d8cb9c tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b.a5b28e5b-2a1b-4732-a6a6-19ac356c17d7" returned: 0 in 0.315s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:02 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bc6d364d-ba0f-4654-ae84-f9fce9d8cb9c tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b.a5b28e5b-2a1b-4732-a6a6-19ac356c17d7 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:03 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b.a5b28e5b-2a1b-4732-a6a6-19ac356c17d7 Jul 17 19:57:03 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:03 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:03 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-bc6d364d-ba0f-4654-ae84-f9fce9d8cb9c tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b.a5b28e5b-2a1b-4732-a6a6-19ac356c17d7" returned: 0 in 0.238s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:03 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-bc6d364d-ba0f-4654-ae84-f9fce9d8cb9c tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-a5b28e5b-2a1b-4732-a6a6-19ac356c17d7" released by "_delete_snapshot" :: held 1.323s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:57:03 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-bc6d364d-ba0f-4654-ae84-f9fce9d8cb9c tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-5f79854f-bb6c-4203-822e-4a053d6c713b" released by "delete_snapshot" :: held 1.343s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:57:03 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-bc6d364d-ba0f-4654-ae84-f9fce9d8cb9c tempest-ProjectMemberTests-1057790160 None] Created reservations ['a145ed2e-878d-4e85-950b-664906b4261c', '1f5f014c-bcc2-413c-a5c0-4a4af6cc5aec', 'f2ca4f4c-8964-4aab-ba36-5eb3c321d8a9', 'c0f705b9-61cb-4363-b4ef-3ca8744fca6c'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:57:03 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-bc6d364d-ba0f-4654-ae84-f9fce9d8cb9c tempest-ProjectMemberTests-1057790160 None] Delete snapshot completed successfully. Jul 17 19:57:03 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-bc6d364d-ba0f-4654-ae84-f9fce9d8cb9c tempest-ProjectMemberTests-1057790160 None] Lock "cinder-a5b28e5b-2a1b-4732-a6a6-19ac356c17d7-delete_snapshot" released by "delete_snapshot" :: held 1.468s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:57:04 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-393a6775-e3da-4f0b-ab3d-c7b7bd8c2396 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-5f79854f-bb6c-4203-822e-4a053d6c713b-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:57:04 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-393a6775-e3da-4f0b-ab3d-c7b7bd8c2396 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-5f79854f-bb6c-4203-822e-4a053d6c713b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:57:04 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-393a6775-e3da-4f0b-ab3d-c7b7bd8c2396 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "cinder-quobyte-5f79854f-bb6c-4203-822e-4a053d6c713b" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:57:04 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-393a6775-e3da-4f0b-ab3d-c7b7bd8c2396 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-5f79854f-bb6c-4203-822e-4a053d6c713b" acquired by "delete_volume" :: waited 0.016s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:57:04 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3486d2-5f86-4308-911a-a573bfebe011]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:57:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-393a6775-e3da-4f0b-ab3d-c7b7bd8c2396 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:04 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b Jul 17 19:57:04 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:04 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-393a6775-e3da-4f0b-ab3d-c7b7bd8c2396 tempest-ProjectMemberTests-1057790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b" returned: 0 in 0.355s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-393a6775-e3da-4f0b-ab3d-c7b7bd8c2396 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:04 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b Jul 17 19:57:04 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:04 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-393a6775-e3da-4f0b-ab3d-c7b7bd8c2396 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-5f79854f-bb6c-4203-822e-4a053d6c713b" returned: 0 in 0.245s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:04 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-393a6775-e3da-4f0b-ab3d-c7b7bd8c2396 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-quobyte-5f79854f-bb6c-4203-822e-4a053d6c713b" released by "delete_volume" :: held 0.668s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:57:04 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-393a6775-e3da-4f0b-ab3d-c7b7bd8c2396 tempest-ProjectMemberTests-1057790160 None] Created reservations ['43cdc866-53bd-4a89-b6d9-57e1180810ec', '99d04079-f119-4edc-bdda-5f524654f8a3', '1fc7b668-e097-4f26-a7d8-f0aade5b04d0', '59124bc7-12c2-46d8-8a61-b5da12a8a7e9'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:57:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-393a6775-e3da-4f0b-ab3d-c7b7bd8c2396 tempest-ProjectMemberTests-1057790160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:57:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-393a6775-e3da-4f0b-ab3d-c7b7bd8c2396 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:57:04 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-393a6775-e3da-4f0b-ab3d-c7b7bd8c2396 tempest-ProjectMemberTests-1057790160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:57:04 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-393a6775-e3da-4f0b-ab3d-c7b7bd8c2396 tempest-ProjectMemberTests-1057790160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:57:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-393a6775-e3da-4f0b-ab3d-c7b7bd8c2396 tempest-ProjectMemberTests-1057790160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:57:04 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-393a6775-e3da-4f0b-ab3d-c7b7bd8c2396 tempest-ProjectMemberTests-1057790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:04 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:57:04 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:05 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:05 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-393a6775-e3da-4f0b-ab3d-c7b7bd8c2396 tempest-ProjectMemberTests-1057790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.243s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:05 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-393a6775-e3da-4f0b-ab3d-c7b7bd8c2396 tempest-ProjectMemberTests-1057790160 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:57:05 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-393a6775-e3da-4f0b-ab3d-c7b7bd8c2396 tempest-ProjectMemberTests-1057790160 None] Deleted volume successfully. Jul 17 19:57:05 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-393a6775-e3da-4f0b-ab3d-c7b7bd8c2396 tempest-ProjectMemberTests-1057790160 None] Lock "cinder-5f79854f-bb6c-4203-822e-4a053d6c713b-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:57:14 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=35,cinder:INSERT=16,cinder:UPDATE=50,cinder:DELETE=2 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:57:15 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:UPDATE=49,cinder:SELECT=36,cinder:INSERT=12,cinder:DELETE=5 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:57:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:57:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:57:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:57:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:57:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:57:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:57:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:15 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:57:15 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:15 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.248s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:15 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:57:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager._thread_info {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:57:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread count: 29 {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 19:57:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread info: [<_MainThread(MainThread, started 130066227544192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 19:57:32 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:57:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] Flow 'volume_create_manager' (6c6df24e-26c1-4962-b42b-5a96128e9311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:57:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94dd7c45-1ab8-4bb0-98bc-77ced822f92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:57:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94dd7c45-1ab8-4bb0-98bc-77ced822f92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-490263951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ef0bc3-6657-42c5-87dc-5ff2f51b13f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1e35dc37aa54f408399a24cad049eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:57:33Z,use_quota=True,user_id='cd72958f7cd54330b83b6d9638fe8eb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:57:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d54286-a0fb-4dd2-9165-30d11c00ee4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:57:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d54286-a0fb-4dd2-9165-30d11c00ee4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:57:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20eab918-6800-4ea4-9bfa-2d40a9b09e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:57:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20eab918-6800-4ea4-9bfa-2d40a9b09e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64ef0bc3-6657-42c5-87dc-5ff2f51b13f2', 'volume_name': 'volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:57:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f1274ba-f26b-4ef2-aee4-11083ead84b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:57:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f1274ba-f26b-4ef2-aee4-11083ead84b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:57:32 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7eb4121-457e-46c3-b3e0-35222e17bc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:57:32 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] Volume 64ef0bc3-6657-42c5-87dc-5ff2f51b13f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2', 'volume_size': 1} Jul 17 19:57:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:57:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:57:32 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-490263951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ef0bc3-6657-42c5-87dc-5ff2f51b13f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1e35dc37aa54f408399a24cad049eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:57:33Z,use_quota=True,user_id='cd72958f7cd54330b83b6d9638fe8eb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)}" {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 19:57:32 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] Creating volume 64ef0bc3-6657-42c5-87dc-5ff2f51b13f2 {{(pid=87726) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 19:57:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:57:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:57:32 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:57:32 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:57:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:57:32 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:57:32 devstack cinder-volume[87726]: INFO cinder.volume.drivers.remotefs [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] casted to osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 Jul 17 19:57:32 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2 1073741824 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:32 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2 1073741824 Jul 17 19:57:32 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:33 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2 1073741824" returned: 0 in 0.379s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:33 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2 Jul 17 19:57:33 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:33 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2" returned: 0 in 0.232s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] <== create_volume: return (650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'} {{(pid=87726) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 19:57:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.652s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:57:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7eb4121-457e-46c3-b3e0-35222e17bc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2', 'volume_size': 1}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:57:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc699c8-788d-4cc8-b22d-d9212a1de46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:57:33 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] Volume volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2 (64ef0bc3-6657-42c5-87dc-5ff2f51b13f2): created successfully Jul 17 19:57:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc699c8-788d-4cc8-b22d-d9212a1de46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:57:33 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] Flow 'volume_create_manager' (6c6df24e-26c1-4962-b42b-5a96128e9311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:57:33 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-4e385432-335b-47b7-b7f0-cdfd076372d8 tempest-SnapshotDependencyTests-1441591857 None] Created volume successfully. Jul 17 19:57:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5aa6e5a7-b316-4263-9a75-394c05340df4 tempest-SnapshotDependencyTests-1441591857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:57:33 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5aa6e5a7-b316-4263-9a75-394c05340df4 tempest-SnapshotDependencyTests-1441591857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:57:33 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-5aa6e5a7-b316-4263-9a75-394c05340df4 tempest-SnapshotDependencyTests-1441591857 None] Creating offline snapshot d4f356ac-fa9b-4a5b-b08e-da9e882d30fa of volume 64ef0bc3-6657-42c5-87dc-5ff2f51b13f2 {{(pid=87726) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 19:57:34 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd62c02e-41bd-4cfd-af2a-4f22d0556ec7]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:57:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5aa6e5a7-b316-4263-9a75-394c05340df4 tempest-SnapshotDependencyTests-1441591857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:34 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2 Jul 17 19:57:34 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:34 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5aa6e5a7-b316-4263-9a75-394c05340df4 tempest-SnapshotDependencyTests-1441591857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2" returned: 0 in 0.339s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5aa6e5a7-b316-4263-9a75-394c05340df4 tempest-SnapshotDependencyTests-1441591857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2.d4f356ac-fa9b-4a5b-b08e-da9e882d30fa 1G {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:34 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2.d4f356ac-fa9b-4a5b-b08e-da9e882d30fa 1G Jul 17 19:57:34 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:34 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5aa6e5a7-b316-4263-9a75-394c05340df4 tempest-SnapshotDependencyTests-1441591857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2.d4f356ac-fa9b-4a5b-b08e-da9e882d30fa 1G" returned: 0 in 0.370s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5aa6e5a7-b316-4263-9a75-394c05340df4 tempest-SnapshotDependencyTests-1441591857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2.d4f356ac-fa9b-4a5b-b08e-da9e882d30fa {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:34 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2.d4f356ac-fa9b-4a5b-b08e-da9e882d30fa Jul 17 19:57:34 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:34 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5aa6e5a7-b316-4263-9a75-394c05340df4 tempest-SnapshotDependencyTests-1441591857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2 -F qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2.d4f356ac-fa9b-4a5b-b08e-da9e882d30fa" returned: 0 in 0.272s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:34 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-5aa6e5a7-b316-4263-9a75-394c05340df4 tempest-SnapshotDependencyTests-1441591857 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2.d4f356ac-fa9b-4a5b-b08e-da9e882d30fa is being set with open permissions: ugo+rw Jul 17 19:57:34 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5aa6e5a7-b316-4263-9a75-394c05340df4 tempest-SnapshotDependencyTests-1441591857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2.d4f356ac-fa9b-4a5b-b08e-da9e882d30fa {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:35 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2.d4f356ac-fa9b-4a5b-b08e-da9e882d30fa Jul 17 19:57:35 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:35 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5aa6e5a7-b316-4263-9a75-394c05340df4 tempest-SnapshotDependencyTests-1441591857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2.d4f356ac-fa9b-4a5b-b08e-da9e882d30fa" returned: 0 in 0.233s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5aa6e5a7-b316-4263-9a75-394c05340df4 tempest-SnapshotDependencyTests-1441591857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:35 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2.info Jul 17 19:57:35 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:35 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5aa6e5a7-b316-4263-9a75-394c05340df4 tempest-SnapshotDependencyTests-1441591857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2.info" returned: 0 in 0.244s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:35 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-5aa6e5a7-b316-4263-9a75-394c05340df4 tempest-SnapshotDependencyTests-1441591857 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2.info is being set with open permissions: ugo+rw Jul 17 19:57:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5aa6e5a7-b316-4263-9a75-394c05340df4 tempest-SnapshotDependencyTests-1441591857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2.info {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:35 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2.info Jul 17 19:57:35 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:35 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-5aa6e5a7-b316-4263-9a75-394c05340df4 tempest-SnapshotDependencyTests-1441591857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2.info" returned: 0 in 0.229s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:35 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-5aa6e5a7-b316-4263-9a75-394c05340df4 tempest-SnapshotDependencyTests-1441591857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.767s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:57:35 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-5aa6e5a7-b316-4263-9a75-394c05340df4 tempest-SnapshotDependencyTests-1441591857 None] Create snapshot completed successfully Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87726) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Flow 'volume_create_manager' (f94de3e0-6757-46f7-881b-f5b215752ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d282e6a3-8113-480f-b9fd-883bcdf34294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d282e6a3-8113-480f-b9fd-883bcdf34294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T17:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1e35dc37aa54f408399a24cad049eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T17:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d4f356ac-fa9b-4a5b-b08e-da9e882d30fa,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T17:57:37Z,use_quota=True,user_id='cd72958f7cd54330b83b6d9638fe8eb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6b5c27-93f2-4bbf-ad4e-8988b9591575),volume_type_id=ee6b5c27-93f2-4bbf-ad4e-8988b9591575)' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a62ed5-1eda-4777-b9fd-ff1c31826609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a62ed5-1eda-4777-b9fd-ff1c31826609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0757c8a-6078-49e6-a87e-6adf6a0b4f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0757c8a-6078-49e6-a87e-6adf6a0b4f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019', 'volume_name': 'volume-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019', 'volume_size': 1, 'snapshot_id': 'd4f356ac-fa9b-4a5b-b08e-da9e882d30fa'}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77d7e46a-92e3-491d-8971-ecc85ab24429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77d7e46a-92e3-491d-8971-ecc85ab24429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb07966-4212-4dc3-af84-ba32c4571e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:57:36 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Volume 3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019', 'volume_size': 1, 'snapshot_id': 'd4f356ac-fa9b-4a5b-b08e-da9e882d30fa'} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Acquiring lock "cinder-quobyte-d4f356ac-fa9b-4a5b-b08e-da9e882d30fa-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019" by "_create_volume_from_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Lock "cinder-quobyte-d4f356ac-fa9b-4a5b-b08e-da9e882d30fa-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Creating volume 3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019 from snapshot d4f356ac-fa9b-4a5b-b08e-da9e882d30fa {{(pid=87726) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Selected osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55 as target Quobyte volume. {{(pid=87726) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Acquiring lock "cinder-quobyte-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019" by "_copy_volume_from_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Lock "cinder-quobyte-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] snapshot: d4f356ac-fa9b-4a5b-b08e-da9e882d30fa, volume: 3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019, {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[196911d3-ea56-43f7-9c8d-4bc0c2bc98a3]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:57:36 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2.d4f356ac-fa9b-4a5b-b08e-da9e882d30fa {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:36 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2.d4f356ac-fa9b-4a5b-b08e-da9e882d30fa Jul 17 19:57:36 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:37 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2.d4f356ac-fa9b-4a5b-b08e-da9e882d30fa" returned: 0 in 0.341s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:57:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2 {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 19:57:37 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Creating direct copy from snapshot {{(pid=87726) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 19:57:37 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[6740b762-d99f-4144-9ba5-c658508c34b0]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:57:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:37 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2 Jul 17 19:57:37 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:37 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2" returned: 0 in 0.342s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:37 devstack cinder-volume[87726]: DEBUG cinder.utils [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Path /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019 not found in is_blk_device check {{(pid=87726) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 19:57:37 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:37 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019 Jul 17 19:57:37 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:41 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019" returned: 0 in 3.834s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:41 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c1a9cf-3bd6-4073-9ddc-88209c44b21e]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:57:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:41 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2 Jul 17 19:57:41 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:41 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2" returned: 0 in 0.523s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:41 devstack cinder-volume[87726]: DEBUG cinder.image.image_utils [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Image conversion details: src /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2, size 1024.00 MB, duration 3.84 sec, destination /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019 {{(pid=87726) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 19:57:41 devstack cinder-volume[87726]: INFO cinder.image.image_utils [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Converted 1024.00 MB image at 266.99 MB/s Jul 17 19:57:41 devstack cinder-volume[87726]: WARNING cinder.volume.drivers.remotefs [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019 is being set with open permissions: ugo+rw Jul 17 19:57:41 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:41 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019 Jul 17 19:57:41 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:42 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019" returned: 0 in 0.254s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:42 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Lock "cinder-quobyte-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019" released by "_copy_volume_from_snapshot" :: held 5.379s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:57:42 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Lock "cinder-quobyte-d4f356ac-fa9b-4a5b-b08e-da9e882d30fa-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019" released by "_create_volume_from_snapshot" :: held 5.407s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:57:42 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.421s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:57:42 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb07966-4212-4dc3-af84-ba32c4571e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019', 'volume_size': 1, 'snapshot_id': 'd4f356ac-fa9b-4a5b-b08e-da9e882d30fa'}' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:57:42 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1985970a-dd91-43f7-b38c-5e3b9a603edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 19:57:42 devstack cinder-volume[87726]: INFO cinder.volume.flows.manager.create_volume [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Volume volume-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019 (3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019): created successfully Jul 17 19:57:42 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1985970a-dd91-43f7-b38c-5e3b9a603edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87726) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 19:57:42 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Flow 'volume_create_manager' (f94de3e0-6757-46f7-881b-f5b215752ec6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87726) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 19:57:42 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-0d9a81ec-c457-49d8-91e0-9faa74cbffb8 tempest-SnapshotDependencyTests-1441591857 None] Created volume successfully. Jul 17 19:57:43 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-41a14dc9-c6fe-4efe-ba74-1917a0f8f464 tempest-SnapshotDependencyTests-1441591857 None] Acquiring lock "cinder-d4f356ac-fa9b-4a5b-b08e-da9e882d30fa-delete_snapshot" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:57:43 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-41a14dc9-c6fe-4efe-ba74-1917a0f8f464 tempest-SnapshotDependencyTests-1441591857 None] Lock "cinder-d4f356ac-fa9b-4a5b-b08e-da9e882d30fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:57:43 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-41a14dc9-c6fe-4efe-ba74-1917a0f8f464 tempest-SnapshotDependencyTests-1441591857 None] Acquiring lock "cinder-quobyte-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2" by "delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:57:43 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-41a14dc9-c6fe-4efe-ba74-1917a0f8f464 tempest-SnapshotDependencyTests-1441591857 None] Lock "cinder-quobyte-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:57:43 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-41a14dc9-c6fe-4efe-ba74-1917a0f8f464 tempest-SnapshotDependencyTests-1441591857 None] Acquiring lock "cinder-quobyte-d4f356ac-fa9b-4a5b-b08e-da9e882d30fa" by "_delete_snapshot" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:57:43 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-41a14dc9-c6fe-4efe-ba74-1917a0f8f464 tempest-SnapshotDependencyTests-1441591857 None] Lock "cinder-quobyte-d4f356ac-fa9b-4a5b-b08e-da9e882d30fa" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:57:43 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-41a14dc9-c6fe-4efe-ba74-1917a0f8f464 tempest-SnapshotDependencyTests-1441591857 None] Deleting offline snapshot d4f356ac-fa9b-4a5b-b08e-da9e882d30fa of volume 64ef0bc3-6657-42c5-87dc-5ff2f51b13f2 {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 19:57:43 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-41a14dc9-c6fe-4efe-ba74-1917a0f8f464 tempest-SnapshotDependencyTests-1441591857 None] snapshot_file for this snap is: volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2.d4f356ac-fa9b-4a5b-b08e-da9e882d30fa {{(pid=87726) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 19:57:43 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[21890066-c24b-4ec4-8d54-158be9a6fae9]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:57:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-41a14dc9-c6fe-4efe-ba74-1917a0f8f464 tempest-SnapshotDependencyTests-1441591857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2.d4f356ac-fa9b-4a5b-b08e-da9e882d30fa {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:43 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2.d4f356ac-fa9b-4a5b-b08e-da9e882d30fa Jul 17 19:57:43 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:43 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-41a14dc9-c6fe-4efe-ba74-1917a0f8f464 tempest-SnapshotDependencyTests-1441591857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2.d4f356ac-fa9b-4a5b-b08e-da9e882d30fa" returned: 0 in 0.354s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:43 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.remotefs [None req-41a14dc9-c6fe-4efe-ba74-1917a0f8f464 tempest-SnapshotDependencyTests-1441591857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87726) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 19:57:43 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61a81c7-e0bd-4512-a3c9-96b52b3375b9]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:57:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-41a14dc9-c6fe-4efe-ba74-1917a0f8f464 tempest-SnapshotDependencyTests-1441591857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:43 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2 Jul 17 19:57:43 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:43 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-41a14dc9-c6fe-4efe-ba74-1917a0f8f464 tempest-SnapshotDependencyTests-1441591857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2" returned: 0 in 0.353s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:43 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-41a14dc9-c6fe-4efe-ba74-1917a0f8f464 tempest-SnapshotDependencyTests-1441591857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2.d4f356ac-fa9b-4a5b-b08e-da9e882d30fa {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:43 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2.d4f356ac-fa9b-4a5b-b08e-da9e882d30fa Jul 17 19:57:43 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:44 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-41a14dc9-c6fe-4efe-ba74-1917a0f8f464 tempest-SnapshotDependencyTests-1441591857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2.d4f356ac-fa9b-4a5b-b08e-da9e882d30fa" returned: 0 in 0.325s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-41a14dc9-c6fe-4efe-ba74-1917a0f8f464 tempest-SnapshotDependencyTests-1441591857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2.d4f356ac-fa9b-4a5b-b08e-da9e882d30fa {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:44 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2.d4f356ac-fa9b-4a5b-b08e-da9e882d30fa Jul 17 19:57:44 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:44 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:44 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-41a14dc9-c6fe-4efe-ba74-1917a0f8f464 tempest-SnapshotDependencyTests-1441591857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2.d4f356ac-fa9b-4a5b-b08e-da9e882d30fa" returned: 0 in 0.239s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:44 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-41a14dc9-c6fe-4efe-ba74-1917a0f8f464 tempest-SnapshotDependencyTests-1441591857 None] Lock "cinder-quobyte-d4f356ac-fa9b-4a5b-b08e-da9e882d30fa" released by "_delete_snapshot" :: held 1.361s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:57:44 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-41a14dc9-c6fe-4efe-ba74-1917a0f8f464 tempest-SnapshotDependencyTests-1441591857 None] Lock "cinder-quobyte-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2" released by "delete_snapshot" :: held 1.383s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:57:44 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-41a14dc9-c6fe-4efe-ba74-1917a0f8f464 tempest-SnapshotDependencyTests-1441591857 None] Created reservations ['bf884982-4d87-4793-8be6-336954dbf12c', '7502471b-6879-472c-a403-f1315eefcc9e', 'fb5e3b48-0cd4-4422-bda5-ddac148b7924', 'd0609df9-0e23-439e-84ca-3307ed0b028f'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:57:44 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-41a14dc9-c6fe-4efe-ba74-1917a0f8f464 tempest-SnapshotDependencyTests-1441591857 None] Delete snapshot completed successfully. Jul 17 19:57:44 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-41a14dc9-c6fe-4efe-ba74-1917a0f8f464 tempest-SnapshotDependencyTests-1441591857 None] Lock "cinder-d4f356ac-fa9b-4a5b-b08e-da9e882d30fa-delete_snapshot" released by "delete_snapshot" :: held 1.503s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:57:45 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-65e08716-0392-414e-b555-8e83448347fe tempest-SnapshotDependencyTests-1441591857 None] Acquiring lock "cinder-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:57:45 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-65e08716-0392-414e-b555-8e83448347fe tempest-SnapshotDependencyTests-1441591857 None] Lock "cinder-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:57:45 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-65e08716-0392-414e-b555-8e83448347fe tempest-SnapshotDependencyTests-1441591857 None] Acquiring lock "cinder-quobyte-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:57:45 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-65e08716-0392-414e-b555-8e83448347fe tempest-SnapshotDependencyTests-1441591857 None] Lock "cinder-quobyte-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2" acquired by "delete_volume" :: waited 0.014s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:57:45 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a9453e-f673-4fc0-9a2d-dc82cb64a668]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:57:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-65e08716-0392-414e-b555-8e83448347fe tempest-SnapshotDependencyTests-1441591857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:45 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2 Jul 17 19:57:45 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:45 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-65e08716-0392-414e-b555-8e83448347fe tempest-SnapshotDependencyTests-1441591857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2" returned: 0 in 0.349s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-65e08716-0392-414e-b555-8e83448347fe tempest-SnapshotDependencyTests-1441591857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:45 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2 Jul 17 19:57:45 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:45 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:45 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-65e08716-0392-414e-b555-8e83448347fe tempest-SnapshotDependencyTests-1441591857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2" returned: 0 in 0.237s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:45 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-65e08716-0392-414e-b555-8e83448347fe tempest-SnapshotDependencyTests-1441591857 None] Lock "cinder-quobyte-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2" released by "delete_volume" :: held 0.637s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:57:46 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-65e08716-0392-414e-b555-8e83448347fe tempest-SnapshotDependencyTests-1441591857 None] Created reservations ['774e4b9e-5e65-4265-a34d-e1acacd31541', '3b0af770-07aa-4068-b130-9525bad26cad', 'dfb8b246-ccea-40e9-932e-016484be8b6c', 'b60c816c-1f07-4820-9b7a-3e15cf64bd4f'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:57:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-65e08716-0392-414e-b555-8e83448347fe tempest-SnapshotDependencyTests-1441591857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:57:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-65e08716-0392-414e-b555-8e83448347fe tempest-SnapshotDependencyTests-1441591857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:57:46 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-65e08716-0392-414e-b555-8e83448347fe tempest-SnapshotDependencyTests-1441591857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:57:46 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-65e08716-0392-414e-b555-8e83448347fe tempest-SnapshotDependencyTests-1441591857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:57:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-65e08716-0392-414e-b555-8e83448347fe tempest-SnapshotDependencyTests-1441591857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:57:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-65e08716-0392-414e-b555-8e83448347fe tempest-SnapshotDependencyTests-1441591857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:46 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:57:46 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:46 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-65e08716-0392-414e-b555-8e83448347fe tempest-SnapshotDependencyTests-1441591857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.234s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:46 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-65e08716-0392-414e-b555-8e83448347fe tempest-SnapshotDependencyTests-1441591857 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:57:46 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-65e08716-0392-414e-b555-8e83448347fe tempest-SnapshotDependencyTests-1441591857 None] Deleted volume successfully. Jul 17 19:57:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-65e08716-0392-414e-b555-8e83448347fe tempest-SnapshotDependencyTests-1441591857 None] Lock "cinder-64ef0bc3-6657-42c5-87dc-5ff2f51b13f2-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:57:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-de72f3e7-c4b5-4559-9c94-de331471c43c tempest-SnapshotDependencyTests-1441591857 None] Acquiring lock "cinder-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019-delete_volume" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:57:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-de72f3e7-c4b5-4559-9c94-de331471c43c tempest-SnapshotDependencyTests-1441591857 None] Lock "cinder-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:57:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-de72f3e7-c4b5-4559-9c94-de331471c43c tempest-SnapshotDependencyTests-1441591857 None] Acquiring lock "cinder-quobyte-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019" by "delete_volume" {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 19:57:46 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-de72f3e7-c4b5-4559-9c94-de331471c43c tempest-SnapshotDependencyTests-1441591857 None] Lock "cinder-quobyte-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019" acquired by "delete_volume" :: waited 0.013s {{(pid=87726) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 19:57:46 devstack cinder-volume[87726]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc15f7d-837d-44b2-b76e-4974e1c9ba1a]: (4, 'qcow2') {{(pid=88674) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 19:57:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-de72f3e7-c4b5-4559-9c94-de331471c43c tempest-SnapshotDependencyTests-1441591857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:46 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019 Jul 17 19:57:46 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:46 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-de72f3e7-c4b5-4559-9c94-de331471c43c tempest-SnapshotDependencyTests-1441591857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019" returned: 0 in 0.355s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:46 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-de72f3e7-c4b5-4559-9c94-de331471c43c tempest-SnapshotDependencyTests-1441591857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:46 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019 Jul 17 19:57:46 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:47 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-de72f3e7-c4b5-4559-9c94-de331471c43c tempest-SnapshotDependencyTests-1441591857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97/volume-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019" returned: 0 in 0.240s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-de72f3e7-c4b5-4559-9c94-de331471c43c tempest-SnapshotDependencyTests-1441591857 None] Lock "cinder-quobyte-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019" released by "delete_volume" :: held 0.635s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:57:47 devstack cinder-volume[87726]: DEBUG cinder.quota [None req-de72f3e7-c4b5-4559-9c94-de331471c43c tempest-SnapshotDependencyTests-1441591857 None] Created reservations ['5a801799-2db0-4e12-89c8-604498e3196d', '9801d8ac-b0a8-49e5-b4e8-7b35e5094f40', '59026e19-cf54-40c1-907e-69a31c980f87', '72e75fc6-9069-48fb-9875-4d91e6074001'] {{(pid=87726) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 19:57:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-de72f3e7-c4b5-4559-9c94-de331471c43c tempest-SnapshotDependencyTests-1441591857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:57:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-de72f3e7-c4b5-4559-9c94-de331471c43c tempest-SnapshotDependencyTests-1441591857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:57:47 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-de72f3e7-c4b5-4559-9c94-de331471c43c tempest-SnapshotDependencyTests-1441591857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:57:47 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-de72f3e7-c4b5-4559-9c94-de331471c43c tempest-SnapshotDependencyTests-1441591857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:57:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-de72f3e7-c4b5-4559-9c94-de331471c43c tempest-SnapshotDependencyTests-1441591857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:57:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-de72f3e7-c4b5-4559-9c94-de331471c43c tempest-SnapshotDependencyTests-1441591857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:57:47 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:57:47 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:57:47 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Jul 17 19:57:47 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-de72f3e7-c4b5-4559-9c94-de331471c43c tempest-SnapshotDependencyTests-1441591857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.241s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:57:47 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-de72f3e7-c4b5-4559-9c94-de331471c43c tempest-SnapshotDependencyTests-1441591857 None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:57:47 devstack cinder-volume[87726]: INFO cinder.volume.manager [None req-de72f3e7-c4b5-4559-9c94-de331471c43c tempest-SnapshotDependencyTests-1441591857 None] Deleted volume successfully. Jul 17 19:57:47 devstack cinder-volume[87726]: DEBUG cinder.coordination [None req-de72f3e7-c4b5-4559-9c94-de331471c43c tempest-SnapshotDependencyTests-1441591857 None] Lock "cinder-3b0f7ff8-ca06-48b3-a9fb-9c8635a5b019-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=87726) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 19:57:57 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:SELECT=23,cinder:UPDATE=33,cinder:DELETE=2,cinder:INSERT=5 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:57:57 devstack cinder-volume[87726]: DEBUG dbcounter [-] [87726] Writing DB stats cinder:UPDATE=23,cinder:SELECT=24,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87726) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 19:58:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:58:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 19:58:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 19:58:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55': None} {{(pid=87726) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 19:58:15 devstack cinder-volume[87726]: DEBUG cinder.volume.drivers.quobyte [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50e02cfd-f9ec-4e4a-b73f-3825ddfc6c55'] {{(pid=87726) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 19:58:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.lockutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87726) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 19:58:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 19:58:15 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97 Jul 17 19:58:15 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 19:58:15 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Jul 17 19:58:15 devstack cinder-volume[87726]: DEBUG oslo_concurrency.processutils [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c71cf8d35d8397bd01395b988ea3b97" returned: 0 in 0.247s {{(pid=87726) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 19:58:15 devstack cinder-volume[87726]: DEBUG cinder.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Notifying Schedulers of capabilities ... {{(pid=87726) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 19:58:15 devstack cinder-volume[87726]: DEBUG oslo_service.periodic_task [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] Running periodic task VolumeManager._thread_info {{(pid=87726) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 19:58:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread count: 29 {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 19:58:15 devstack cinder-volume[87726]: DEBUG cinder.volume.manager [None req-c66e343d-2922-457a-b1cc-f48dda01e9f8 None None] thread info: [<_MainThread(MainThread, started 130066227544192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87726) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}